2026-02-17T18:32:18.498 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3 2026-02-17T18:32:18.512 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T18:32:18.588 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_15:45:02-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/53793 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: null first_in_suite: false flavor: default job_id: '53793' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_15:45:02-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5319 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMDQ9YH9kETurC9wyWZjW298ZVx26bF/EAALS676aF7D+SFvWsRpGO17JF3Ccn/E7KgymilNWGCrluAEswd5nlE= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: 5f66ecfb34c0370410e78b3ee641753d19da653b timestamp: 2026-02-17_15:45:02 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T18:32:18.588 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-17T18:32:18.588 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-17T18:32:18.588 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T18:32:18.590 INFO:teuthology.task.internal:Checking packages... 2026-02-17T18:32:18.590 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-17T18:32:18.590 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T18:32:18.590 INFO:teuthology.packaging:ref: None 2026-02-17T18:32:18.590 INFO:teuthology.packaging:tag: None 2026-02-17T18:32:18.590 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-17T18:32:18.590 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-17T18:32:18.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-17T18:32:18.712 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230-gafefaa40-1jammy 2026-02-17T18:32:18.713 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T18:32:18.726 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T18:32:18.726 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T18:32:18.739 INFO:teuthology.task.internal:Saving configuration 2026-02-17T18:32:18.747 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T18:32:18.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T18:32:18.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial067.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_15:45:02-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/53793', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 18:26:42.153125', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP0d6jBvNT3Qb8GTnEq8fF3FKTm8CCK98KueKI77zkfO'} 2026-02-17T18:32:18.841 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T18:32:18.852 INFO:teuthology.task.internal:roles: ubuntu@trial067.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T18:32:18.852 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T18:32:18.927 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7383109e6fc0>, signals=[15]) 2026-02-17T18:32:18.927 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T18:32:18.938 INFO:teuthology.task.internal:Opening connections... 2026-02-17T18:32:18.938 DEBUG:teuthology.task.internal:connecting to ubuntu@trial067.front.sepia.ceph.com 2026-02-17T18:32:18.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T18:32:19.004 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T18:32:19.015 DEBUG:teuthology.orchestra.run.trial067:> uname -m 2026-02-17T18:32:19.080 INFO:teuthology.orchestra.run.trial067.stdout:x86_64 2026-02-17T18:32:19.081 DEBUG:teuthology.orchestra.run.trial067:> cat /etc/os-release 2026-02-17T18:32:19.127 INFO:teuthology.orchestra.run.trial067.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T18:32:19.127 INFO:teuthology.orchestra.run.trial067.stdout:NAME="Ubuntu" 2026-02-17T18:32:19.127 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_ID="22.04" 2026-02-17T18:32:19.127 INFO:teuthology.orchestra.run.trial067.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T18:32:19.127 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_CODENAME=jammy 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:ID=ubuntu 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:ID_LIKE=debian 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T18:32:19.128 INFO:teuthology.orchestra.run.trial067.stdout:UBUNTU_CODENAME=jammy 2026-02-17T18:32:19.128 INFO:teuthology.lock.ops:Updating trial067.front.sepia.ceph.com on lock server 2026-02-17T18:32:19.212 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T18:32:19.232 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T18:32:19.258 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T18:32:19.258 DEBUG:teuthology.orchestra.run.trial067:> test '!' -e /home/ubuntu/cephtest 2026-02-17T18:32:19.261 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T18:32:19.272 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T18:32:19.272 DEBUG:teuthology.orchestra.run.trial067:> test -z $(ls -A /var/lib/ceph) 2026-02-17T18:32:19.308 INFO:teuthology.orchestra.run.trial067.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T18:32:19.309 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T18:32:19.409 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T18:32:19.428 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-17T18:32:19.428 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-17T18:32:19.428 DEBUG:teuthology.orchestra.run.trial067:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T18:32:19.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T18:32:19.431 DEBUG:teuthology.orchestra.run.trial067:> uname -r 2026-02-17T18:32:19.475 INFO:teuthology.orchestra.run.trial067.stdout:5.15.0-164-generic 2026-02-17T18:32:19.475 INFO:teuthology.task.kernel:Running kernel on trial067: 5.15.0-164-generic 2026-02-17T18:32:19.475 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-get clean 2026-02-17T18:32:19.537 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-get update 2026-02-17T18:32:19.732 INFO:teuthology.orchestra.run.trial067.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T18:32:19.739 INFO:teuthology.orchestra.run.trial067.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T18:32:19.778 INFO:teuthology.orchestra.run.trial067.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T18:32:19.787 INFO:teuthology.orchestra.run.trial067.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T18:32:19.878 INFO:teuthology.orchestra.run.trial067.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T18:32:19.949 INFO:teuthology.orchestra.run.trial067.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T18:32:19.951 INFO:teuthology.orchestra.run.trial067.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T18:32:20.336 INFO:teuthology.orchestra.run.trial067.stdout:Fetched 5114 kB in 1s (8325 kB/s) 2026-02-17T18:32:21.048 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:32:21.061 DEBUG:teuthology.orchestra.run.trial067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T18:32:21.094 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:32:21.200 INFO:teuthology.orchestra.run.trial067.stdout:Building dependency tree... 2026-02-17T18:32:21.200 INFO:teuthology.orchestra.run.trial067.stdout:Reading state information... 2026-02-17T18:32:21.286 INFO:teuthology.orchestra.run.trial067.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T18:32:21.286 INFO:teuthology.orchestra.run.trial067.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T18:32:21.286 INFO:teuthology.orchestra.run.trial067.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T18:32:21.286 INFO:teuthology.orchestra.run.trial067.stdout: sg3-utils-udev 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout:The following additional packages will be installed: 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout:Suggested packages: 2026-02-17T18:32:21.287 INFO:teuthology.orchestra.run.trial067.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T18:32:21.299 INFO:teuthology.orchestra.run.trial067.stdout:The following NEW packages will be installed: 2026-02-17T18:32:21.299 INFO:teuthology.orchestra.run.trial067.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T18:32:21.299 INFO:teuthology.orchestra.run.trial067.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T18:32:21.299 INFO:teuthology.orchestra.run.trial067.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T18:32:21.300 INFO:teuthology.orchestra.run.trial067.stdout:The following packages will be upgraded: 2026-02-17T18:32:21.300 INFO:teuthology.orchestra.run.trial067.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T18:32:21.707 INFO:teuthology.orchestra.run.trial067.stdout:3 upgraded, 5 newly installed, 0 to remove and 53 not upgraded. 2026-02-17T18:32:21.707 INFO:teuthology.orchestra.run.trial067.stdout:Need to get 113 MB of archives. 2026-02-17T18:32:21.708 INFO:teuthology.orchestra.run.trial067.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T18:32:21.708 INFO:teuthology.orchestra.run.trial067.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T18:32:23.040 INFO:teuthology.orchestra.run.trial067.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T18:32:23.368 INFO:teuthology.orchestra.run.trial067.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T18:32:25.235 INFO:teuthology.orchestra.run.trial067.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T18:32:25.236 INFO:teuthology.orchestra.run.trial067.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T18:32:25.236 INFO:teuthology.orchestra.run.trial067.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T18:32:25.577 INFO:teuthology.orchestra.run.trial067.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T18:32:25.653 INFO:teuthology.orchestra.run.trial067.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T18:32:25.851 INFO:teuthology.orchestra.run.trial067.stdout:Fetched 113 MB in 4s (26.1 MB/s) 2026-02-17T18:32:25.871 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T18:32:26.032 INFO:teuthology.orchestra.run.trial067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T18:32:26.033 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T18:32:26.034 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:26.386 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T18:32:26.392 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T18:32:26.413 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:26.453 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T18:32:26.460 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T18:32:26.460 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:27.565 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T18:32:27.566 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T18:32:27.588 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T18:32:27.589 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T18:32:27.607 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T18:32:27.614 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T18:32:27.614 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T18:32:28.974 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T18:32:28.985 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T18:32:28.986 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:29.570 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T18:32:29.570 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T18:32:29.595 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T18:32:29.596 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:29.598 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T18:32:29.599 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:30.366 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:31.186 INFO:teuthology.orchestra.run.trial067.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T18:32:31.186 INFO:teuthology.orchestra.run.trial067.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T18:32:31.194 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:31.983 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T18:32:31.984 INFO:teuthology.orchestra.run.trial067.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T18:32:31.985 INFO:teuthology.orchestra.run.trial067.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T18:32:31.990 INFO:teuthology.orchestra.run.trial067.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T18:32:31.990 INFO:teuthology.orchestra.run.trial067.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T18:32:39.075 INFO:teuthology.orchestra.run.trial067.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T18:32:45.595 INFO:teuthology.orchestra.run.trial067.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T18:32:45.595 INFO:teuthology.orchestra.run.trial067.stdout:Sourcing file `/etc/default/grub' 2026-02-17T18:32:45.618 INFO:teuthology.orchestra.run.trial067.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T18:32:45.619 INFO:teuthology.orchestra.run.trial067.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T18:32:45.621 INFO:teuthology.orchestra.run.trial067.stdout:Generating grub configuration file ... 2026-02-17T18:32:45.700 INFO:teuthology.orchestra.run.trial067.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T18:32:45.707 INFO:teuthology.orchestra.run.trial067.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T18:32:45.877 INFO:teuthology.orchestra.run.trial067.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T18:32:45.882 INFO:teuthology.orchestra.run.trial067.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T18:32:45.953 INFO:teuthology.orchestra.run.trial067.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T18:32:45.954 INFO:teuthology.orchestra.run.trial067.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T18:32:45.954 INFO:teuthology.orchestra.run.trial067.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T18:32:45.956 INFO:teuthology.orchestra.run.trial067.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T18:32:45.965 INFO:teuthology.orchestra.run.trial067.stdout:done 2026-02-17T18:32:46.385 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout:Pending kernel upgrade! 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout:Running kernel version: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: 5.15.0-164-generic 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout:Diagnostics: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T18:32:46.386 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout:The processor microcode seems to be up-to-date. 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout:No services need to be restarted. 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout:No containers need to be restarted. 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout:No user sessions are running outdated binaries. 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:32:46.387 INFO:teuthology.orchestra.run.trial067.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T18:32:47.067 DEBUG:teuthology.orchestra.run.trial067:> dpkg -s linux-image-generic 2026-02-17T18:32:47.079 INFO:teuthology.orchestra.run.trial067.stdout:Package: linux-image-generic 2026-02-17T18:32:47.079 INFO:teuthology.orchestra.run.trial067.stdout:Status: install ok installed 2026-02-17T18:32:47.079 INFO:teuthology.orchestra.run.trial067.stdout:Priority: optional 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Section: kernel 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Installed-Size: 21 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Architecture: amd64 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Source: linux-meta 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Version: 5.15.0.170.159 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T18:32:47.080 INFO:teuthology.orchestra.run.trial067.stdout:Recommends: thermald 2026-02-17T18:32:47.081 INFO:teuthology.orchestra.run.trial067.stdout:Description: Generic Linux kernel image 2026-02-17T18:32:47.081 INFO:teuthology.orchestra.run.trial067.stdout: This package will always depend on the latest generic kernel image 2026-02-17T18:32:47.081 INFO:teuthology.orchestra.run.trial067.stdout: available. 2026-02-17T18:32:47.081 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T18:32:47.081 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T18:32:47.081 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T18:32:47.082 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T18:32:47.082 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial067.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T18:32:47.082 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-get clean 2026-02-17T18:32:47.160 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-get update 2026-02-17T18:32:47.346 INFO:teuthology.orchestra.run.trial067.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T18:32:47.352 INFO:teuthology.orchestra.run.trial067.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T18:32:47.363 INFO:teuthology.orchestra.run.trial067.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T18:32:47.374 INFO:teuthology.orchestra.run.trial067.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T18:32:48.204 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:32:48.220 DEBUG:teuthology.orchestra.run.trial067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T18:32:48.254 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:32:48.363 INFO:teuthology.orchestra.run.trial067.stdout:Building dependency tree... 2026-02-17T18:32:48.363 INFO:teuthology.orchestra.run.trial067.stdout:Reading state information... 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout:linux-image-generic set to manually installed. 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout: sg3-utils-udev 2026-02-17T18:32:48.448 INFO:teuthology.orchestra.run.trial067.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T18:32:48.468 INFO:teuthology.orchestra.run.trial067.stdout:0 upgraded, 0 newly installed, 0 to remove and 53 not upgraded. 2026-02-17T18:32:48.470 DEBUG:teuthology.orchestra.run.trial067:> dpkg -s linux-image-generic 2026-02-17T18:32:48.521 INFO:teuthology.orchestra.run.trial067.stdout:Package: linux-image-generic 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Status: install ok installed 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Priority: optional 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Section: kernel 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Installed-Size: 21 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Architecture: amd64 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Source: linux-meta 2026-02-17T18:32:48.522 INFO:teuthology.orchestra.run.trial067.stdout:Version: 5.15.0.170.159 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout:Recommends: thermald 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout:Description: Generic Linux kernel image 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout: This package will always depend on the latest generic kernel image 2026-02-17T18:32:48.523 INFO:teuthology.orchestra.run.trial067.stdout: available. 2026-02-17T18:32:48.523 DEBUG:teuthology.orchestra.run.trial067:> mktemp 2026-02-17T18:32:48.568 INFO:teuthology.orchestra.run.trial067.stdout:/tmp/tmp.RhFyt2EOSw 2026-02-17T18:32:48.568 DEBUG:teuthology.orchestra.run.trial067:> sudo cp /boot/grub/grub.cfg /tmp/tmp.RhFyt2EOSw 2026-02-17T18:32:48.617 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod 0666 /tmp/tmp.RhFyt2EOSw 2026-02-17T18:32:48.716 DEBUG:teuthology.orchestra.remote:trial067:/tmp/tmp.RhFyt2EOSw is 7KB 2026-02-17T18:32:48.762 DEBUG:teuthology.orchestra.run.trial067:> rm -fr /tmp/tmp.RhFyt2EOSw 2026-02-17T18:32:48.767 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T18:32:48.817 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:32:48.817 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T18:32:48.817 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T18:32:48.874 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T18:32:48.875 DEBUG:teuthology.orchestra.run.trial067:> sudo update-grub 2026-02-17T18:32:49.111 INFO:teuthology.orchestra.run.trial067.stderr:Sourcing file `/etc/default/grub' 2026-02-17T18:32:49.129 INFO:teuthology.orchestra.run.trial067.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T18:32:49.130 INFO:teuthology.orchestra.run.trial067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T18:32:49.132 INFO:teuthology.orchestra.run.trial067.stderr:Generating grub configuration file ... 2026-02-17T18:32:49.213 INFO:teuthology.orchestra.run.trial067.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T18:32:49.219 INFO:teuthology.orchestra.run.trial067.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T18:32:49.391 INFO:teuthology.orchestra.run.trial067.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T18:32:49.397 INFO:teuthology.orchestra.run.trial067.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T18:32:49.465 INFO:teuthology.orchestra.run.trial067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T18:32:49.465 INFO:teuthology.orchestra.run.trial067.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T18:32:49.465 INFO:teuthology.orchestra.run.trial067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T18:32:49.468 INFO:teuthology.orchestra.run.trial067.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T18:32:49.473 INFO:teuthology.orchestra.run.trial067.stderr:done 2026-02-17T18:32:49.475 DEBUG:teuthology.orchestra.run.trial067:> sudo shutdown -r now 2026-02-17T18:33:19.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T18:33:19.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial067.front.sepia.ceph.com' 2026-02-17T18:33:19.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T18:34:19.551 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T18:34:28.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial067.front.sepia.ceph.com' 2026-02-17T18:34:28.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T18:34:28.683 DEBUG:teuthology.orchestra.run.trial067:> true 2026-02-17T18:34:29.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial067.front.sepia.ceph.com' 2026-02-17T18:34:29.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T18:34:29.071 DEBUG:teuthology.orchestra.run.trial067:> uname -r 2026-02-17T18:34:29.118 INFO:teuthology.orchestra.run.trial067.stdout:5.15.0-170-generic 2026-02-17T18:34:29.119 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T18:34:29.119 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T18:34:29.119 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T18:34:30.119 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T18:34:30.119 DEBUG:teuthology.orchestra.run.trial067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T18:34:30.132 INFO:teuthology.orchestra.run.trial067.stdout:ttyS1 2026-02-17T18:34:30.157 DEBUG:teuthology.parallel:result is None 2026-02-17T18:34:30.157 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T18:34:30.169 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T18:34:30.169 DEBUG:teuthology.orchestra.run.trial067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T18:34:30.202 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T18:34:30.215 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T18:34:30.229 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T18:34:30.229 DEBUG:teuthology.orchestra.run.trial067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T18:34:30.252 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T18:34:30.263 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T18:34:30.263 DEBUG:teuthology.orchestra.run.trial067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T18:34:30.303 INFO:teuthology.orchestra.run.trial067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:34:30.309 INFO:teuthology.orchestra.run.trial067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:34:30.310 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T18:34:30.323 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T18:34:30.323 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T18:34:30.366 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T18:34:30.383 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T18:34:30.383 DEBUG:teuthology.orchestra.run.trial067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T18:34:30.414 DEBUG:teuthology.orchestra.run.trial067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T18:34:30.458 DEBUG:teuthology.orchestra.run.trial067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T18:34:30.502 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:34:30.503 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T18:34:30.550 DEBUG:teuthology.orchestra.run.trial067:> sudo service rsyslog restart 2026-02-17T18:34:30.607 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T18:34:30.620 INFO:teuthology.task.internal:Starting timer... 2026-02-17T18:34:30.620 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T18:34:30.640 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T18:34:30.658 DEBUG:teuthology.task.selinux:Excluding trial067: OS 'ubuntu' does not support SELinux 2026-02-17T18:34:30.658 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T18:34:30.658 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T18:34:30.658 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T18:34:30.658 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T18:34:30.673 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T18:34:30.684 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T18:34:30.685 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T18:35:30.043 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial067.front.sepia.ceph.com')] 2026-02-17T18:35:30.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial067.front.sepia.ceph.com' 2026-02-17T18:35:30.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T18:35:30.142 DEBUG:teuthology.orchestra.run.trial067:> true 2026-02-17T18:35:30.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial067.front.sepia.ceph.com' 2026-02-17T18:35:30.389 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T18:35:30.402 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T18:35:30.402 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T18:35:30.402 DEBUG:teuthology.orchestra.run.trial067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Command line: ntpd -gq 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: ---------------------------------------------------- 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: corporation. Support and training for ntp-4 are 2026-02-17T18:35:30.451 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: available at https://www.nwtime.org/support 2026-02-17T18:35:30.452 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: ---------------------------------------------------- 2026-02-17T18:35:30.452 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: proto: precision = 0.030 usec (-25) 2026-02-17T18:35:30.452 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: basedate set to 2022-02-04 2026-02-17T18:35:30.452 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: gps base set to 2022-02-06 (week 2196) 2026-02-17T18:35:30.452 INFO:teuthology.orchestra.run.trial067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T18:35:30.453 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T18:35:30.453 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T18:35:30.453 INFO:teuthology.orchestra.run.trial067.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T18:35:30.454 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T18:35:30.454 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T18:35:30.454 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T18:35:30.454 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen normally on 3 enp1s0f0 10.20.193.67:123 2026-02-17T18:35:30.454 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen normally on 4 lo [::1]:123 2026-02-17T18:35:30.455 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5fde%2]:123 2026-02-17T18:35:30.455 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:30 ntpd[4911]: Listening on routing socket on fd #22 for interface updates 2026-02-17T18:35:31.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:31.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:31.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:31.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:31.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:31.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:31 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:33.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:33.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:33.474 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:33.474 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:33.474 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:33.474 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:33 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:34.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:34.451 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:34.451 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:34.451 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:34.459 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:34.460 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:34.460 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:34.460 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:34.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:34.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:34.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:34.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:34 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:35.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:35.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:35.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:35.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:35.472 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:35.472 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:35.472 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:35.473 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:35.485 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:35.485 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:35.485 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:35.485 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:35 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:36.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:36.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:36.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:36.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:36.458 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:36.458 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:36.459 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:36.459 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:36.511 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:36.511 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:36.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:36.512 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:36 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:37.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:37.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:37.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:37.450 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:37.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T18:35:37.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T18:35:37.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T18:35:37.470 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T18:35:37.471 INFO:teuthology.orchestra.run.trial067.stdout:17 Feb 18:35:37 ntpd[4911]: ntpd: time slew +0.000291 s 2026-02-17T18:35:37.471 INFO:teuthology.orchestra.run.trial067.stdout:ntpd: time slew +0.000291s 2026-02-17T18:35:37.472 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T18:35:37.472 INFO:teuthology.orchestra.run.trial067.stderr:17 Feb 18:35:37 ntpd[4911]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout:============================================================================== 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout: 23.155.72.147 ( .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout: owners.kjsl.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T18:35:37.530 INFO:teuthology.orchestra.run.trial067.stdout: arm1.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T18:35:37.531 INFO:teuthology.run_tasks:Running task install... 2026-02-17T18:35:37.541 DEBUG:teuthology.task.install:project ceph 2026-02-17T18:35:37.542 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-17T18:35:37.542 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-17T18:35:37.542 INFO:teuthology.task.install:Using flavor: default 2026-02-17T18:35:37.548 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T18:35:37.548 INFO:teuthology.task.install:extra packages: [] 2026-02-17T18:35:37.548 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-key list | grep Ceph 2026-02-17T18:35:37.620 INFO:teuthology.orchestra.run.trial067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T18:35:37.645 INFO:teuthology.orchestra.run.trial067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T18:35:37.645 INFO:teuthology.orchestra.run.trial067.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T18:35:37.646 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T18:35:37.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-17T18:35:37.784 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default/ 2026-02-17T18:35:37.784 INFO:teuthology.task.install.deb:Package version is 20.3.0-5230-gafefaa40-1jammy 2026-02-17T18:35:37.992 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:35:37.992 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T18:35:38.001 DEBUG:teuthology.orchestra.run.trial067:> sudo apt-get update 2026-02-17T18:35:38.248 INFO:teuthology.orchestra.run.trial067.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T18:35:38.283 INFO:teuthology.orchestra.run.trial067.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-17T18:35:38.318 INFO:teuthology.orchestra.run.trial067.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T18:35:38.353 INFO:teuthology.orchestra.run.trial067.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-17T18:35:38.568 INFO:teuthology.orchestra.run.trial067.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T18:35:38.646 INFO:teuthology.orchestra.run.trial067.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T18:35:38.729 INFO:teuthology.orchestra.run.trial067.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T18:35:38.812 INFO:teuthology.orchestra.run.trial067.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T18:35:38.958 INFO:teuthology.orchestra.run.trial067.stdout:Fetched 26.9 kB in 1s (33.8 kB/s) 2026-02-17T18:35:39.482 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:35:39.495 DEBUG:teuthology.orchestra.run.trial067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5230-gafefaa40-1jammy cephadm=20.3.0-5230-gafefaa40-1jammy ceph-mds=20.3.0-5230-gafefaa40-1jammy ceph-mgr=20.3.0-5230-gafefaa40-1jammy ceph-osd=20.3.0-5230-gafefaa40-1jammy ceph-osd-classic=20.3.0-5230-gafefaa40-1jammy ceph-common=20.3.0-5230-gafefaa40-1jammy ceph-fuse=20.3.0-5230-gafefaa40-1jammy ceph-test=20.3.0-5230-gafefaa40-1jammy ceph-volume=20.3.0-5230-gafefaa40-1jammy radosgw=20.3.0-5230-gafefaa40-1jammy python3-rados=20.3.0-5230-gafefaa40-1jammy python3-rgw=20.3.0-5230-gafefaa40-1jammy python3-cephfs=20.3.0-5230-gafefaa40-1jammy python3-rbd=20.3.0-5230-gafefaa40-1jammy libcephfs2=20.3.0-5230-gafefaa40-1jammy libcephfs-dev=20.3.0-5230-gafefaa40-1jammy librados2=20.3.0-5230-gafefaa40-1jammy librbd1=20.3.0-5230-gafefaa40-1jammy rbd-fuse=20.3.0-5230-gafefaa40-1jammy 2026-02-17T18:35:39.528 INFO:teuthology.orchestra.run.trial067.stdout:Reading package lists... 2026-02-17T18:35:39.638 INFO:teuthology.orchestra.run.trial067.stdout:Building dependency tree... 2026-02-17T18:35:39.639 INFO:teuthology.orchestra.run.trial067.stdout:Reading state information... 2026-02-17T18:35:39.729 INFO:teuthology.orchestra.run.trial067.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: sg3-utils-udev 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout:The following additional packages will be installed: 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-17T18:35:39.730 INFO:teuthology.orchestra.run.trial067.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout:Suggested packages: 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout:Recommended packages: 2026-02-17T18:35:39.731 INFO:teuthology.orchestra.run.trial067.stdout: btrfs-tools 2026-02-17T18:35:39.766 INFO:teuthology.orchestra.run.trial067.stdout:The following NEW packages will be installed: 2026-02-17T18:35:39.766 INFO:teuthology.orchestra.run.trial067.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T18:35:39.766 INFO:teuthology.orchestra.run.trial067.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T18:35:39.766 INFO:teuthology.orchestra.run.trial067.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-17T18:35:39.767 INFO:teuthology.orchestra.run.trial067.stdout: socat xmlstarlet 2026-02-17T18:35:40.021 INFO:teuthology.orchestra.run.trial067.stdout:0 upgraded, 87 newly installed, 0 to remove and 53 not upgraded. 2026-02-17T18:35:40.021 INFO:teuthology.orchestra.run.trial067.stdout:Need to get 701 MB of archives. 2026-02-17T18:35:40.021 INFO:teuthology.orchestra.run.trial067.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-17T18:35:40.021 INFO:teuthology.orchestra.run.trial067.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5230-gafefaa40-1jammy [3798 kB] 2026-02-17T18:35:40.116 INFO:teuthology.orchestra.run.trial067.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T18:35:40.455 INFO:teuthology.orchestra.run.trial067.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T18:35:40.467 INFO:teuthology.orchestra.run.trial067.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T18:35:40.536 INFO:teuthology.orchestra.run.trial067.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T18:35:40.579 INFO:teuthology.orchestra.run.trial067.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5230-gafefaa40-1jammy [2910 kB] 2026-02-17T18:35:40.737 INFO:teuthology.orchestra.run.trial067.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T18:35:40.747 INFO:teuthology.orchestra.run.trial067.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T18:35:40.768 INFO:teuthology.orchestra.run.trial067.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5230-gafefaa40-1jammy [882 kB] 2026-02-17T18:35:40.773 INFO:teuthology.orchestra.run.trial067.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T18:35:40.782 INFO:teuthology.orchestra.run.trial067.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T18:35:40.784 INFO:teuthology.orchestra.run.trial067.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T18:35:40.784 INFO:teuthology.orchestra.run.trial067.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T18:35:40.785 INFO:teuthology.orchestra.run.trial067.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T18:35:40.802 INFO:teuthology.orchestra.run.trial067.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T18:35:40.803 INFO:teuthology.orchestra.run.trial067.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T18:35:40.809 INFO:teuthology.orchestra.run.trial067.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T18:35:40.837 INFO:teuthology.orchestra.run.trial067.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5230-gafefaa40-1jammy [359 kB] 2026-02-17T18:35:40.852 INFO:teuthology.orchestra.run.trial067.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5230-gafefaa40-1jammy [32.8 kB] 2026-02-17T18:35:40.853 INFO:teuthology.orchestra.run.trial067.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5230-gafefaa40-1jammy [225 kB] 2026-02-17T18:35:40.865 INFO:teuthology.orchestra.run.trial067.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5230-gafefaa40-1jammy [88.4 kB] 2026-02-17T18:35:40.867 INFO:teuthology.orchestra.run.trial067.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5230-gafefaa40-1jammy [339 kB] 2026-02-17T18:35:40.875 INFO:teuthology.orchestra.run.trial067.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T18:35:40.875 INFO:teuthology.orchestra.run.trial067.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T18:35:40.875 INFO:teuthology.orchestra.run.trial067.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T18:35:40.876 INFO:teuthology.orchestra.run.trial067.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T18:35:40.876 INFO:teuthology.orchestra.run.trial067.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T18:35:40.876 INFO:teuthology.orchestra.run.trial067.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T18:35:40.876 INFO:teuthology.orchestra.run.trial067.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T18:35:40.881 INFO:teuthology.orchestra.run.trial067.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T18:35:40.881 INFO:teuthology.orchestra.run.trial067.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T18:35:40.919 INFO:teuthology.orchestra.run.trial067.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5230-gafefaa40-1jammy [9083 kB] 2026-02-17T18:35:40.951 INFO:teuthology.orchestra.run.trial067.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T18:35:40.953 INFO:teuthology.orchestra.run.trial067.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T18:35:40.953 INFO:teuthology.orchestra.run.trial067.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T18:35:40.954 INFO:teuthology.orchestra.run.trial067.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T18:35:40.979 INFO:teuthology.orchestra.run.trial067.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T18:35:40.981 INFO:teuthology.orchestra.run.trial067.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T18:35:40.981 INFO:teuthology.orchestra.run.trial067.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T18:35:41.038 INFO:teuthology.orchestra.run.trial067.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T18:35:41.038 INFO:teuthology.orchestra.run.trial067.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T18:35:41.039 INFO:teuthology.orchestra.run.trial067.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T18:35:41.039 INFO:teuthology.orchestra.run.trial067.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T18:35:41.039 INFO:teuthology.orchestra.run.trial067.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T18:35:41.040 INFO:teuthology.orchestra.run.trial067.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T18:35:41.098 INFO:teuthology.orchestra.run.trial067.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T18:35:41.099 INFO:teuthology.orchestra.run.trial067.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T18:35:41.100 INFO:teuthology.orchestra.run.trial067.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T18:35:41.170 INFO:teuthology.orchestra.run.trial067.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T18:35:41.172 INFO:teuthology.orchestra.run.trial067.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T18:35:41.175 INFO:teuthology.orchestra.run.trial067.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T18:35:41.178 INFO:teuthology.orchestra.run.trial067.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T18:35:41.184 INFO:teuthology.orchestra.run.trial067.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T18:35:41.184 INFO:teuthology.orchestra.run.trial067.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T18:35:41.184 INFO:teuthology.orchestra.run.trial067.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T18:35:41.242 INFO:teuthology.orchestra.run.trial067.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T18:35:41.242 INFO:teuthology.orchestra.run.trial067.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T18:35:41.248 INFO:teuthology.orchestra.run.trial067.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T18:35:41.314 INFO:teuthology.orchestra.run.trial067.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T18:35:41.316 INFO:teuthology.orchestra.run.trial067.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T18:35:41.316 INFO:teuthology.orchestra.run.trial067.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T18:35:41.317 INFO:teuthology.orchestra.run.trial067.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T18:35:41.578 INFO:teuthology.orchestra.run.trial067.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5230-gafefaa40-1jammy [112 kB] 2026-02-17T18:35:41.605 INFO:teuthology.orchestra.run.trial067.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5230-gafefaa40-1jammy [261 kB] 2026-02-17T18:35:41.618 INFO:teuthology.orchestra.run.trial067.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5230-gafefaa40-1jammy [31.5 MB] 2026-02-17T18:35:49.701 INFO:teuthology.orchestra.run.trial067.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5230-gafefaa40-1jammy [4982 kB] 2026-02-17T18:35:50.053 INFO:teuthology.orchestra.run.trial067.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5230-gafefaa40-1jammy [293 kB] 2026-02-17T18:35:50.057 INFO:teuthology.orchestra.run.trial067.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5230-gafefaa40-1jammy [127 kB] 2026-02-17T18:35:50.092 INFO:teuthology.orchestra.run.trial067.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5230-gafefaa40-1jammy [922 kB] 2026-02-17T18:35:50.143 INFO:teuthology.orchestra.run.trial067.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5230-gafefaa40-1jammy [7542 kB] 2026-02-17T18:35:50.691 INFO:teuthology.orchestra.run.trial067.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5230-gafefaa40-1jammy [468 MB] 2026-02-17T18:36:01.109 INFO:teuthology.orchestra.run.trial067.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5230-gafefaa40-1jammy [180 kB] 2026-02-17T18:36:01.110 INFO:teuthology.orchestra.run.trial067.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5230-gafefaa40-1jammy [14.0 kB] 2026-02-17T18:36:01.110 INFO:teuthology.orchestra.run.trial067.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5230-gafefaa40-1jammy [1030 kB] 2026-02-17T18:36:01.115 INFO:teuthology.orchestra.run.trial067.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5230-gafefaa40-1jammy [2438 kB] 2026-02-17T18:36:01.128 INFO:teuthology.orchestra.run.trial067.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5230-gafefaa40-1jammy [1068 kB] 2026-02-17T18:36:01.134 INFO:teuthology.orchestra.run.trial067.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5230-gafefaa40-1jammy [190 kB] 2026-02-17T18:36:01.135 INFO:teuthology.orchestra.run.trial067.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5230-gafefaa40-1jammy [54.5 MB] 2026-02-17T18:36:02.027 INFO:teuthology.orchestra.run.trial067.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5230-gafefaa40-1jammy [8626 kB] 2026-02-17T18:36:02.157 INFO:teuthology.orchestra.run.trial067.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5230-gafefaa40-1jammy [14.2 kB] 2026-02-17T18:36:02.157 INFO:teuthology.orchestra.run.trial067.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5230-gafefaa40-1jammy [68.6 MB] 2026-02-17T18:36:03.350 INFO:teuthology.orchestra.run.trial067.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5230-gafefaa40-1jammy [136 kB] 2026-02-17T18:36:03.351 INFO:teuthology.orchestra.run.trial067.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5230-gafefaa40-1jammy [45.1 kB] 2026-02-17T18:36:03.351 INFO:teuthology.orchestra.run.trial067.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5230-gafefaa40-1jammy [31.7 kB] 2026-02-17T18:36:03.351 INFO:teuthology.orchestra.run.trial067.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5230-gafefaa40-1jammy [44.2 kB] 2026-02-17T18:36:03.352 INFO:teuthology.orchestra.run.trial067.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5230-gafefaa40-1jammy [18.3 MB] 2026-02-17T18:36:03.651 INFO:teuthology.orchestra.run.trial067.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5230-gafefaa40-1jammy [93.5 kB] 2026-02-17T18:36:03.953 INFO:teuthology.orchestra.run.trial067.stdout:Fetched 701 MB in 24s (29.4 MB/s) 2026-02-17T18:36:03.970 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T18:36:04.122 INFO:teuthology.orchestra.run.trial067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T18:36:04.124 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T18:36:04.125 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T18:36:04.146 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T18:36:04.158 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T18:36:04.158 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T18:36:04.174 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T18:36:04.186 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T18:36:04.186 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T18:36:04.206 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T18:36:04.214 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T18:36:04.219 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:04.252 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T18:36:04.262 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T18:36:04.262 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:04.278 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T18:36:04.286 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T18:36:04.286 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:04.306 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T18:36:04.314 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T18:36:04.314 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T18:36:04.330 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package librados2. 2026-02-17T18:36:04.338 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../07-librados2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.338 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.378 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libnbd0. 2026-02-17T18:36:04.387 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T18:36:04.387 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T18:36:04.402 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package librbd1. 2026-02-17T18:36:04.409 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../09-librbd1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.410 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.446 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T18:36:04.455 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.455 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.474 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-rados. 2026-02-17T18:36:04.482 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.482 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.499 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T18:36:04.508 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:04.508 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.522 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T18:36:04.529 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.530 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.546 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T18:36:04.554 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:04.554 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.572 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T18:36:04.579 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T18:36:04.579 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T18:36:04.594 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T18:36:04.602 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T18:36:04.602 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T18:36:04.617 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T18:36:04.625 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.625 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.642 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T18:36:04.650 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T18:36:04.651 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T18:36:04.668 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package librgw2. 2026-02-17T18:36:04.676 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../19-librgw2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.676 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.773 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T18:36:04.782 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.782 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.797 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T18:36:04.805 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T18:36:04.805 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T18:36:04.819 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T18:36:04.827 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.827 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:04.844 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-common. 2026-02-17T18:36:04.852 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:04.852 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.109 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-base. 2026-02-17T18:36:05.118 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:05.123 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.182 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T18:36:05.190 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T18:36:05.191 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T18:36:05.205 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T18:36:05.213 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T18:36:05.213 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T18:36:05.230 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T18:36:05.239 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T18:36:05.239 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T18:36:05.254 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T18:36:05.262 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T18:36:05.262 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T18:36:05.277 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T18:36:05.285 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T18:36:05.285 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T18:36:05.299 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T18:36:05.307 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T18:36:05.307 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T18:36:05.322 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-portend. 2026-02-17T18:36:05.330 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-17T18:36:05.330 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T18:36:05.344 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T18:36:05.352 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T18:36:05.352 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T18:36:05.367 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T18:36:05.375 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T18:36:05.375 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T18:36:05.398 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T18:36:05.406 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T18:36:05.406 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T18:36:05.422 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T18:36:05.431 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:05.431 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.460 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T18:36:05.469 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:05.469 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.485 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T18:36:05.492 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:05.493 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.514 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T18:36:05.521 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:05.522 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:05.585 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T18:36:05.594 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T18:36:05.594 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T18:36:05.610 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-17T18:36:05.618 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:05.618 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.565 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T18:36:09.578 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:09.578 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.597 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph. 2026-02-17T18:36:09.610 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../42-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:09.610 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.625 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T18:36:09.637 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:09.638 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.662 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T18:36:09.673 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:09.673 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.705 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package cephadm. 2026-02-17T18:36:09.713 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../45-cephadm_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:09.713 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.730 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T18:36:09.737 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T18:36:09.738 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T18:36:09.759 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T18:36:09.767 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:09.767 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:09.788 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T18:36:09.797 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T18:36:09.797 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T18:36:09.812 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-routes. 2026-02-17T18:36:09.820 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T18:36:09.820 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T18:36:09.839 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T18:36:09.847 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:09.848 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:10.531 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T18:36:10.541 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T18:36:10.541 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T18:36:10.580 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T18:36:10.589 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T18:36:10.589 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T18:36:10.616 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T18:36:10.624 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T18:36:10.624 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T18:36:10.639 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T18:36:10.647 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T18:36:10.648 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T18:36:10.730 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T18:36:10.739 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:10.739 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:10.894 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T18:36:10.903 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T18:36:10.903 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T18:36:10.917 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T18:36:10.926 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-17T18:36:10.926 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T18:36:10.943 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T18:36:10.951 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T18:36:10.952 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T18:36:10.969 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T18:36:10.978 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T18:36:10.978 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T18:36:10.994 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T18:36:11.002 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T18:36:11.002 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T18:36:11.020 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T18:36:11.028 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T18:36:11.029 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T18:36:11.121 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T18:36:11.130 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:11.130 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:11.144 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T18:36:11.153 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T18:36:11.153 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T18:36:11.168 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T18:36:11.176 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T18:36:11.177 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T18:36:11.191 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package jq. 2026-02-17T18:36:11.200 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T18:36:11.200 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T18:36:11.214 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package socat. 2026-02-17T18:36:11.222 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T18:36:11.222 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T18:36:11.242 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T18:36:11.250 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T18:36:11.250 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T18:36:11.287 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-test. 2026-02-17T18:36:11.295 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:11.295 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:11.939 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T18:36:11.948 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-17T18:36:11.948 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:11.971 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-17T18:36:11.979 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:11.980 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:11.993 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-17T18:36:12.002 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:12.002 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:12.016 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T18:36:12.024 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:12.025 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:12.041 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T18:36:12.050 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T18:36:12.050 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T18:36:12.085 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T18:36:12.093 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T18:36:12.094 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T18:36:12.123 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T18:36:12.131 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T18:36:12.131 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T18:36:12.145 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T18:36:12.154 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T18:36:12.154 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T18:36:12.170 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T18:36:12.178 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T18:36:12.179 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T18:36:12.197 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-py. 2026-02-17T18:36:12.205 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-17T18:36:12.205 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T18:36:12.225 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T18:36:12.233 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T18:36:12.234 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T18:36:12.275 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-toml. 2026-02-17T18:36:12.284 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-17T18:36:12.284 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T18:36:12.299 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T18:36:12.307 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T18:36:12.307 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T18:36:12.329 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T18:36:12.338 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T18:36:12.338 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T18:36:12.362 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package python3-webob. 2026-02-17T18:36:12.370 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T18:36:12.370 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T18:36:12.387 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T18:36:12.395 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T18:36:12.395 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T18:36:12.461 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package radosgw. 2026-02-17T18:36:12.470 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../85-radosgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:12.470 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:12.671 INFO:teuthology.orchestra.run.trial067.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T18:36:12.680 INFO:teuthology.orchestra.run.trial067.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-17T18:36:12.680 INFO:teuthology.orchestra.run.trial067.stdout:Unpacking rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:12.708 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T18:36:12.777 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T18:36:12.778 INFO:teuthology.orchestra.run.trial067.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T18:36:12.848 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T18:36:13.109 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T18:36:13.481 INFO:teuthology.orchestra.run.trial067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T18:36:13.492 INFO:teuthology.orchestra.run.trial067.stdout:Setting up cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:13.535 INFO:teuthology.orchestra.run.trial067.stdout:Adding system user cephadm....done 2026-02-17T18:36:13.541 INFO:teuthology.orchestra.run.trial067.stdout:usermod: no changes 2026-02-17T18:36:13.547 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T18:36:13.613 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T18:36:13.614 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T18:36:13.685 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T18:36:13.760 INFO:teuthology.orchestra.run.trial067.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T18:36:13.761 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T18:36:13.857 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T18:36:13.981 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T18:36:14.056 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T18:36:14.130 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:14.196 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T18:36:14.197 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T18:36:14.198 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T18:36:14.199 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T18:36:14.200 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T18:36:14.321 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T18:36:14.400 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:14.401 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T18:36:14.480 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T18:36:14.571 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T18:36:14.822 INFO:teuthology.orchestra.run.trial067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T18:36:14.823 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T18:36:14.920 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T18:36:15.046 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T18:36:15.127 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T18:36:15.202 INFO:teuthology.orchestra.run.trial067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T18:36:15.203 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:15.299 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T18:36:15.802 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:15.807 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T18:36:15.884 INFO:teuthology.orchestra.run.trial067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T18:36:15.885 INFO:teuthology.orchestra.run.trial067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T18:36:15.886 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T18:36:15.955 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T18:36:16.025 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:16.026 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T18:36:16.107 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T18:36:16.180 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T18:36:16.260 INFO:teuthology.orchestra.run.trial067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T18:36:16.261 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T18:36:16.346 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T18:36:16.347 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T18:36:16.426 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T18:36:16.511 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T18:36:16.582 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T18:36:16.583 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T18:36:16.717 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T18:36:16.790 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T18:36:16.791 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T18:36:16.872 INFO:teuthology.orchestra.run.trial067.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T18:36:16.873 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T18:36:17.013 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T18:36:17.013 INFO:teuthology.orchestra.run.trial067.stdout:Setting up librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.014 INFO:teuthology.orchestra.run.trial067.stdout:Setting up librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.015 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.016 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T18:36:17.542 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.543 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.544 INFO:teuthology.orchestra.run.trial067.stdout:Setting up librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.545 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.546 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:17.618 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T18:36:17.618 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T18:36:18.004 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.005 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.006 INFO:teuthology.orchestra.run.trial067.stdout:Setting up libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.007 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.008 INFO:teuthology.orchestra.run.trial067.stdout:Setting up rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.009 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.009 INFO:teuthology.orchestra.run.trial067.stdout:Setting up python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.010 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.038 INFO:teuthology.orchestra.run.trial067.stdout:Adding group ceph....done 2026-02-17T18:36:18.073 INFO:teuthology.orchestra.run.trial067.stdout:Adding system user ceph....done 2026-02-17T18:36:18.084 INFO:teuthology.orchestra.run.trial067.stdout:Setting system user ceph properties....done 2026-02-17T18:36:18.089 INFO:teuthology.orchestra.run.trial067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T18:36:18.180 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T18:36:18.455 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T18:36:18.844 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:18.845 INFO:teuthology.orchestra.run.trial067.stdout:Setting up radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:19.085 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T18:36:19.085 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T18:36:19.453 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:19.576 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T18:36:19.945 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.004 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T18:36:20.004 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T18:36:20.362 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.439 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T18:36:20.439 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T18:36:20.814 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.815 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.832 INFO:teuthology.orchestra.run.trial067.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-17T18:36:20.841 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.851 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:20.928 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T18:36:20.928 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T18:36:21.333 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:21.344 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:21.355 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:21.452 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T18:36:21.452 INFO:teuthology.orchestra.run.trial067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T18:36:21.833 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:21.833 INFO:teuthology.orchestra.run.trial067.stdout:Setting up ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-17T18:36:21.942 INFO:teuthology.orchestra.run.trial067.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T18:36:22.025 INFO:teuthology.orchestra.run.trial067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T18:36:22.438 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:Running kernel seems to be up-to-date. 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:The processor microcode seems to be up-to-date. 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:No services need to be restarted. 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:No containers need to be restarted. 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:No user sessions are running outdated binaries. 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout: 2026-02-17T18:36:22.439 INFO:teuthology.orchestra.run.trial067.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T18:36:23.092 INFO:teuthology.orchestra.run.trial067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T18:36:23.097 DEBUG:teuthology.parallel:result is None 2026-02-17T18:36:23.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-17T18:36:23.225 DEBUG:teuthology.orchestra.run.trial067:> dpkg-query -W -f '${Version}' ceph 2026-02-17T18:36:23.235 INFO:teuthology.orchestra.run.trial067.stdout:20.3.0-5230-gafefaa40-1jammy 2026-02-17T18:36:23.235 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230-gafefaa40-1jammy 2026-02-17T18:36:23.235 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230-gafefaa40-1jammy is installed. 2026-02-17T18:36:23.237 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T18:36:23.237 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:36:23.237 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T18:36:23.284 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T18:36:23.284 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:36:23.285 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T18:36:23.335 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T18:36:23.383 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T18:36:23.383 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:36:23.383 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T18:36:23.433 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T18:36:23.484 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T18:36:23.484 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:36:23.484 DEBUG:teuthology.orchestra.run.trial067:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T18:36:23.533 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T18:36:23.584 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T18:36:23.600 INFO:tasks.workunit:Pulling workunits from ref afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-17T18:36:23.600 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T18:36:23.600 INFO:tasks.workunit:timeout=3h 2026-02-17T18:36:23.600 INFO:tasks.workunit:cleanup=True 2026-02-17T18:36:23.600 DEBUG:teuthology.orchestra.run.trial067:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T18:36:23.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T18:36:23.628 INFO:teuthology.orchestra.run.trial067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T18:36:23.628 DEBUG:teuthology.orchestra.run.trial067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T18:36:23.671 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T18:36:23.672 DEBUG:teuthology.orchestra.run.trial067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T18:36:23.716 DEBUG:teuthology.orchestra.run.trial067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-17T18:36:23.767 INFO:tasks.workunit.client.0.trial067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T18:59:31.320 INFO:tasks.workunit.client.0.trial067.stderr:Note: switching to 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'. 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr: git switch -c 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.321 INFO:tasks.workunit.client.0.trial067.stderr:Or undo this operation with: 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr: git switch - 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T18:59:31.322 INFO:tasks.workunit.client.0.trial067.stderr:HEAD is now at afefaa40503 Merge branch 'block_non_4k_chunks' of https://github.com/aainscow/ceph into wip-yuri4-testing-2026-02-11-2126 2026-02-17T18:59:31.322 DEBUG:teuthology.orchestra.run.trial067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T18:59:31.369 DEBUG:teuthology.orchestra.run.trial067:> set -ex 2026-02-17T18:59:31.369 DEBUG:teuthology.orchestra.run.trial067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T18:59:31.416 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-17T18:59:31.417 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-17T18:59:31.418 DEBUG:teuthology.orchestra.run.trial067:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-17T18:59:31.470 INFO:tasks.workunit.client.0.trial067.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T18:59:31.486 INFO:tasks.workunit.client.0.trial067.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T18:59:31.486 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-17T18:59:31.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:35271 2026-02-17T18:59:31.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:35271 2026-02-17T18:59:31.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-17T18:59:31.488 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-17T18:59:31.489 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none ' 2026-02-17T18:59:31.489 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:35271 ' 2026-02-17T18:59:31.489 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-17T18:59:31.489 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-17T18:59:31.489 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T18:59:31.490 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T18:59:31.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T18:59:31.492 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T18:59:31.492 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T18:59:31.493 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T18:59:31.494 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T18:59:31.494 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T18:59:31.494 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T18:59:31.495 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T18:59:31.495 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:31.495 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T18:59:31.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T18:59:31.496 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:31.497 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T18:59:31.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T18:59:31.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T18:59:31.500 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T18:59:31.500 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.500 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7555 2026-02-17T18:59:31.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T18:59:31.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T18:59:31.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-17T18:59:31.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T18:59:31.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7555 2026-02-17T18:59:31.504 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-17T18:59:31.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-17T18:59:31.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-17T18:59:31.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T18:59:31.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:31.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:31.539 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:31.540 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.540 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.540 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:31.540 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T18:59:31.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T18:59:31.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T18:59:31.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T18:59:31.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T18:59:31.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T18:59:31.574 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T18:59:31.574 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T18:59:31.574 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T18:59:31.574 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T18:59:31.574 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T18:59:31.575 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.575 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.575 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7555/ceph-mon.a.asok 2026-02-17T18:59:31.575 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T18:59:31.575 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7555/ceph-mon.a.asok config get fsid 2026-02-17T18:59:31.631 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T18:59:31.631 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T18:59:31.631 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T18:59:31.631 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T18:59:31.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7555/ceph-mon.a.asok 2026-02-17T18:59:31.633 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T18:59:31.634 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7555/ceph-mon.a.asok config get mon_host 2026-02-17T18:59:31.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-17T18:59:31.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-17T18:59:31.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T18:59:31.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T18:59:31.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T18:59:31.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-17T18:59:31.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T18:59:31.803 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:31.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T18:59:31.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-17T18:59:31.829 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 ' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:31.830 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T18:59:31.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=20c9b49b-65f2-4f87-832c-ef209ec029d9 2026-02-17T18:59:31.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 20c9b49b-65f2-4f87-832c-ef209ec029d9' 2026-02-17T18:59:31.833 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 20c9b49b-65f2-4f87-832c-ef209ec029d9 2026-02-17T18:59:31.833 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T18:59:31.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCTupRpQgJzMRAAKKyTX25o56zHd+xi0VLzow== 2026-02-17T18:59:31.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCTupRpQgJzMRAAKKyTX25o56zHd+xi0VLzow=="}' 2026-02-17T18:59:31.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 20c9b49b-65f2-4f87-832c-ef209ec029d9 -i td/bad-inc-map/0/new.json 2026-02-17T18:59:31.949 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:31.957 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-17T18:59:31.958 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCTupRpQgJzMRAAKKyTX25o56zHd+xi0VLzow== --osd-uuid 20c9b49b-65f2-4f87-832c-ef209ec029d9 2026-02-17T18:59:31.973 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:31.960+0000 7f2a7d9caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:31.975 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:31.960+0000 7f2a7d9caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:31.976 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:31.960+0000 7f2a7d9caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:31.976 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:31.964+0000 7f2a7d9caa40 -1 bdev(0x55f0bab26400 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-17T18:59:31.976 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:31.964+0000 7f2a7d9caa40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-17T18:59:32.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-17T18:59:32.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T18:59:32.629 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T18:59:32.629 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T18:59:32.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T18:59:32.739 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T18:59:32.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T18:59:32.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T18:59:32.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T18:59:32.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T18:59:32.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T18:59:32.753 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:32.740+0000 7f855f868a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:32.755 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:32.740+0000 7f855f868a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:32.755 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:32.740+0000 7f855f868a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:32.852 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T18:59:32.852 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:32.853 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:32.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:32.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:32.959 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:33.153 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:33.140+0000 7f855f868a40 -1 Falling back to public interface 2026-02-17T18:59:33.961 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:33.961 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:33.962 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:33.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T18:59:33.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:33.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:34.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:34.212 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:34.200+0000 7f855f868a40 -1 osd.0 0 log_to_monitors true 2026-02-17T18:59:35.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:35.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:35.070 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T18:59:35.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T18:59:35.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:35.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:35.281 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1664524045,v1:127.0.0.1:6801/1664524045] [v2:127.0.0.1:6802/1664524045,v1:127.0.0.1:6803/1664524045] exists,up 20c9b49b-65f2-4f87-832c-ef209ec029d9 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T18:59:35.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 ' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T18:59:35.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T18:59:35.287 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-17T18:59:35.288 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T18:59:35.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b8308f85-e9bc-4310-b579-6a0c02ad68f9 2026-02-17T18:59:35.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b8308f85-e9bc-4310-b579-6a0c02ad68f9' 2026-02-17T18:59:35.290 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 b8308f85-e9bc-4310-b579-6a0c02ad68f9 2026-02-17T18:59:35.290 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T18:59:35.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCXupRpmAsvERAA28NULqRenAUVssZ4sEBH9w== 2026-02-17T18:59:35.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCXupRpmAsvERAA28NULqRenAUVssZ4sEBH9w=="}' 2026-02-17T18:59:35.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b8308f85-e9bc-4310-b579-6a0c02ad68f9 -i td/bad-inc-map/1/new.json 2026-02-17T18:59:35.519 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:35.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-17T18:59:35.531 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCXupRpmAsvERAA28NULqRenAUVssZ4sEBH9w== --osd-uuid b8308f85-e9bc-4310-b579-6a0c02ad68f9 2026-02-17T18:59:35.555 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:35.540+0000 7f7fb5dd3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:35.557 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:35.544+0000 7f7fb5dd3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:35.558 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:35.544+0000 7f7fb5dd3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:35.558 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:35.544+0000 7f7fb5dd3a40 -1 bdev(0x557837bc2400 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-17T18:59:35.558 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:35.544+0000 7f7fb5dd3a40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-17T18:59:36.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-17T18:59:36.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T18:59:36.181 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T18:59:36.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T18:59:36.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T18:59:36.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T18:59:36.476 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T18:59:36.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T18:59:36.477 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T18:59:36.477 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T18:59:36.477 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T18:59:36.498 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:36.484+0000 7f681e8e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:36.500 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:36.488+0000 7f681e8e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:36.501 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:36.488+0000 7f681e8e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:36.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:36.684 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:36.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:36.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T18:59:36.881 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:36.868+0000 7f681e8e6a40 -1 Falling back to public interface 2026-02-17T18:59:36.892 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:37.530 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:37.516+0000 7f681e8e6a40 -1 osd.1 0 log_to_monitors true 2026-02-17T18:59:37.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:37.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:37.894 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:37.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T18:59:37.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:37.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T18:59:38.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:39.111 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:39.111 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:39.111 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T18:59:39.112 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T18:59:39.112 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:39.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T18:59:39.323 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2080705929,v1:127.0.0.1:6811/2080705929] [v2:127.0.0.1:6812/2080705929,v1:127.0.0.1:6813/2080705929] exists,up b8308f85-e9bc-4310-b579-6a0c02ad68f9 2026-02-17T18:59:39.327 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:39.327 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:39.327 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:39.327 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 ' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-17T18:59:39.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T18:59:39.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-17T18:59:39.330 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T18:59:39.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=18199474-376b-4336-9cfa-aafa82aaf7ff 2026-02-17T18:59:39.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 18199474-376b-4336-9cfa-aafa82aaf7ff' 2026-02-17T18:59:39.331 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 18199474-376b-4336-9cfa-aafa82aaf7ff 2026-02-17T18:59:39.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T18:59:39.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCbupRpuAuTExAABG8iU4eZ78gWbo+CTBD2lg== 2026-02-17T18:59:39.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCbupRpuAuTExAABG8iU4eZ78gWbo+CTBD2lg=="}' 2026-02-17T18:59:39.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 18199474-376b-4336-9cfa-aafa82aaf7ff -i td/bad-inc-map/2/new.json 2026-02-17T18:59:39.558 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T18:59:39.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-17T18:59:39.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCbupRpuAuTExAABG8iU4eZ78gWbo+CTBD2lg== --osd-uuid 18199474-376b-4336-9cfa-aafa82aaf7ff 2026-02-17T18:59:39.593 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:39.580+0000 7fa139a60a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:39.595 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:39.580+0000 7fa139a60a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:39.596 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:39.584+0000 7fa139a60a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:39.596 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:39.584+0000 7fa139a60a40 -1 bdev(0x55e9493fe400 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-17T18:59:39.597 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:39.584+0000 7fa139a60a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-17T18:59:40.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-17T18:59:40.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T18:59:40.243 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T18:59:40.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T18:59:40.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T18:59:40.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T18:59:40.547 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T18:59:40.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=2655831b-375d-49ff-a77d-f801ba6d0e2c --auth-supported=none --mon-host=127.0.0.1:35271 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7555/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T18:59:40.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T18:59:40.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T18:59:40.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T18:59:40.569 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:40.556+0000 7f9e4014fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:40.571 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:40.556+0000 7f9e4014fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:40.572 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:40.556+0000 7f9e4014fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:40.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:40.755 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:40.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:40.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:40.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T18:59:40.954 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:40.940+0000 7f9e4014fa40 -1 Falling back to public interface 2026-02-17T18:59:40.966 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:41.524 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:41.508+0000 7f9e4014fa40 -1 osd.2 0 log_to_monitors true 2026-02-17T18:59:41.967 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:41.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:41.968 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:41.969 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T18:59:41.969 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:41.969 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T18:59:42.184 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1394961366,v1:127.0.0.1:6819/1394961366] [v2:127.0.0.1:6820/1394961366,v1:127.0.0.1:6821/1394961366] exists,up 18199474-376b-4336-9cfa-aafa82aaf7ff 2026-02-17T18:59:42.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:42.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:42.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:42.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-17T18:59:42.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-17T18:59:42.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-17T18:59:42.700 INFO:tasks.workunit.client.0.trial067.stderr:pool 'foo' already exists 2026-02-17T18:59:42.710 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T18:59:43.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-17T18:59:44.023 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 min_size to 1 2026-02-17T18:59:44.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-17T18:59:44.327 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 min_size to 2 2026-02-17T18:59:44.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-17T18:59:49.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T18:59:49.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-17T18:59:49.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:49.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T18:59:49.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:49.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:49.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T18:59:49.344 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:49.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:49.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:49.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:49.553 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1664524045,v1:127.0.0.1:6801/1664524045] [v2:127.0.0.1:6802/1664524045,v1:127.0.0.1:6803/1664524045] exists,up 20c9b49b-65f2-4f87-832c-ef209ec029d9 2026-02-17T18:59:49.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:49.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T18:59:49.556 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:49.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:49.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:49.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T18:59:49.771 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2080705929,v1:127.0.0.1:6811/2080705929] [v2:127.0.0.1:6812/2080705929,v1:127.0.0.1:6813/2080705929] exists,up b8308f85-e9bc-4310-b579-6a0c02ad68f9 2026-02-17T18:59:49.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:49.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:49.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T18:59:49.774 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:49.774 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:49.774 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:49.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T18:59:49.984 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 13 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1394961366,v1:127.0.0.1:6819/1394961366] [v2:127.0.0.1:6820/1394961366,v1:127.0.0.1:6821/1394961366] exists,up 18199474-376b-4336-9cfa-aafa82aaf7ff 2026-02-17T18:59:49.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:49.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:49.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:49.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-17T18:59:49.986 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.632+0000 7f9e2f0ef640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.986 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.732+0000 7f9e2f0ef640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.986 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.836+0000 7f9e2f0ef640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.986 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:43.908+0000 7f9e2d0eb640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.986 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.008+0000 7f9e2f0ef640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.008+0000 7f9e2f0ef640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.212+0000 7f9e2d0eb640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.312+0000 7f9e2d0eb640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.316+0000 7f9e2f0ef640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.316+0000 7f9e2d0eb640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-17T18:59:49.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.632+0000 7f9e2f0ef640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.732+0000 7f9e2f0ef640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:42.836+0000 7f9e2f0ef640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:43.908+0000 7f9e2d0eb640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.008+0000 7f9e2f0ef640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T18:59:49.988 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.012+0000 7f9e2f0ef640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.212+0000 7f9e2d0eb640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.312+0000 7f9e2d0eb640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.316+0000 7f9e2f0ef640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T18:59:44.316+0000 7f9e2d0eb640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stdout:success 2026-02-17T18:59:49.989 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-17T18:59:49.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-17T18:59:49.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-17T18:59:49.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-17T18:59:50.200 INFO:tasks.workunit.client.0.trial067.stderr:pool 'foo' does not exist 2026-02-17T18:59:50.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-17T18:59:50.212 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T18:59:50.212 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T18:59:50.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T18:59:50.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T18:59:50.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T18:59:55.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T18:59:55.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-17T18:59:55.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T18:59:55.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T18:59:55.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T18:59:55.534 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T18:59:55.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T18:59:55.535 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T18:59:55.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T18:59:55.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T18:59:55.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T18:59:55.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T18:59:55.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T18:59:55.538 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T18:59:55.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T18:59:55.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T18:59:55.551 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T18:59:55.551 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.552 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:55.552 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7555 2026-02-17T18:59:55.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T18:59:55.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T18:59:55.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T18:59:55.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T18:59:55.556 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T18:59:55.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T18:59:55.557 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T18:59:55.558 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T18:59:55.558 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T18:59:55.559 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T18:59:55.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.560 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T18:59:55.560 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T18:59:55.560 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.561 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T18:59:55.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T18:59:55.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T18:59:55.563 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T18:59:55.563 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.563 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7555 2026-02-17T18:59:55.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7555 2026-02-17T18:59:55.565 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T18:59:55.565 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T18:59:55.565 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T18:59:55.566 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T18:59:55.566 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T18:59:55.620 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-17T18:59:55.621 DEBUG:teuthology.orchestra.run.trial067:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-17T18:59:55.673 INFO:tasks.workunit.client.0.trial067.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T18:59:55.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-17T18:59:55.679 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-17T18:59:55.680 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-17T18:59:55.680 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-17T18:59:55.680 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-17T18:59:55.680 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-17T18:59:55.680 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-17T18:59:55.681 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-17T18:59:55.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-17T18:59:55.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-17T18:59:55.682 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-17T18:59:55.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-17T18:59:55.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-17T18:59:55.684 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-17T18:59:55.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none ' 2026-02-17T18:59:55.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-17T18:59:55.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-17T18:59:55.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-17T18:59:55.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T18:59:55.686 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-17T18:59:55.686 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:TEST_divergent_2 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:TEST_divergent_3 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:TEST_divergent_ec' 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T18:59:55.689 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T18:59:55.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T18:59:55.691 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T18:59:55.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T18:59:55.692 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T18:59:55.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T18:59:55.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T18:59:55.693 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T18:59:55.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T18:59:55.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T18:59:55.695 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T18:59:55.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T18:59:55.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T18:59:55.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T18:59:55.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T18:59:55.699 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.699 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:55.699 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T18:59:55.700 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T18:59:55.700 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T18:59:55.700 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T18:59:55.702 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T18:59:55.702 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.702 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:55.702 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16378 2026-02-17T18:59:55.703 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T18:59:55.704 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T18:59:55.705 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T18:59:55.706 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.jsY5Kb9SPp 2026-02-17T18:59:55.706 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.jsY5Kb9SPp bs=512 count=1 2026-02-17T18:59:55.707 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T18:59:55.707 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T18:59:55.707 INFO:tasks.workunit.client.0.trial067.stderr:512 bytes copied, 0.000239225 s, 2.1 MB/s 2026-02-17T18:59:55.708 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.jsY5Kb9SPp 2026-02-17T18:59:55.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.jsY5Kb9SPp 2026-02-17T18:59:55.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-17T18:59:55.709 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-17T18:59:55.709 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T18:59:55.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T18:59:55.712 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T18:59:55.712 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T18:59:55.712 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T18:59:55.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T18:59:55.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:55.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:55.740 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:55.740 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.741 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:55.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:55.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T18:59:55.771 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T18:59:55.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T18:59:55.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T18:59:55.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T18:59:55.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T18:59:55.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get fsid 2026-02-17T18:59:55.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T18:59:55.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T18:59:55.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T18:59:55.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T18:59:55.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:55.830 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:55.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T18:59:55.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T18:59:55.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get mon_host 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T18:59:55.885 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T18:59:56.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T18:59:56.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:56.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:56.029 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:56.030 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:56.030 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:56.030 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:56.030 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T18:59:56.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T18:59:56.053 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T18:59:56.054 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:56.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T18:59:56.056 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T18:59:56.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T18:59:56.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8e423ae8-8648-44f2-91ac-03a1be36d0ff' 2026-02-17T18:59:56.057 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T18:59:56.058 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T18:59:56.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCsupRpA5BvAxAAaKkeeK3F9ujHsLLjz9vMSg== 2026-02-17T18:59:56.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCsupRpA5BvAxAAaKkeeK3F9ujHsLLjz9vMSg=="}' 2026-02-17T18:59:56.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8e423ae8-8648-44f2-91ac-03a1be36d0ff -i td/divergent-priors/0/new.json 2026-02-17T18:59:56.183 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:56.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T18:59:56.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCsupRpA5BvAxAAaKkeeK3F9ujHsLLjz9vMSg== --osd-uuid 8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T18:59:56.212 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:56.200+0000 7f0843710a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:56.214 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:56.200+0000 7f0843710a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:56.215 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:56.200+0000 7f0843710a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:56.215 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:56.200+0000 7f0843710a40 -1 bdev(0x55f599330400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T18:59:56.216 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:56.200+0000 7f0843710a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T18:59:56.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T18:59:56.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T18:59:56.896 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T18:59:56.896 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T18:59:56.896 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T18:59:57.017 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T18:59:57.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T18:59:57.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T18:59:57.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T18:59:57.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T18:59:57.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T18:59:57.046 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:57.032+0000 7fcc03f8da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:57.048 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:57.036+0000 7fcc03f8da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:57.050 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:57.036+0000 7fcc03f8da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T18:59:57.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:57.131 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T18:59:57.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T18:59:57.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:57.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:57.237 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:57.438 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:57.424+0000 7fcc03f8da40 -1 Falling back to public interface 2026-02-17T18:59:58.239 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:58.239 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:58.239 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:58.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T18:59:58.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:58.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:58.352 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T18:59:58.514 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:58.500+0000 7fcc03f8da40 -1 osd.0 0 log_to_monitors true 2026-02-17T18:59:59.353 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T18:59:59.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T18:59:59.354 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T18:59:59.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T18:59:59.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T18:59:59.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T18:59:59.566 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1073127426,v1:127.0.0.1:6801/1073127426] [v2:127.0.0.1:6802/1073127426,v1:127.0.0.1:6803/1073127426] exists,up 8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T18:59:59.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T18:59:59.571 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T18:59:59.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T18:59:59.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T18:59:59.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T18:59:59.574 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T18:59:59.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 08adb77f-8e22-41a1-b55d-91125cab5c18' 2026-02-17T18:59:59.574 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T18:59:59.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCvupRp9QhNIhAArCv0nsCdAf4j5oWnABp+uw== 2026-02-17T18:59:59.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCvupRp9QhNIhAArCv0nsCdAf4j5oWnABp+uw=="}' 2026-02-17T18:59:59.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 08adb77f-8e22-41a1-b55d-91125cab5c18 -i td/divergent-priors/1/new.json 2026-02-17T18:59:59.810 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T18:59:59.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T18:59:59.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCvupRp9QhNIhAArCv0nsCdAf4j5oWnABp+uw== --osd-uuid 08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T18:59:59.839 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:59.824+0000 7f086619da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:59.841 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:59.828+0000 7f086619da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:59.841 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:59.828+0000 7f086619da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T18:59:59.842 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:59.828+0000 7f086619da40 -1 bdev(0x560ec2f7e400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T18:59:59.842 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T18:59:59.828+0000 7f086619da40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T19:00:00.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T19:00:00.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:00:00.572 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:00:00.572 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:00:00.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:00:00.876 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:00:00.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:00:00.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:00:00.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:00:00.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:00:00.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:00:00.894 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:00.880+0000 7fcbe2cb9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:00.896 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:00.880+0000 7fcbe2cb9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:00.897 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:00.884+0000 7fcbe2cb9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:01.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:00:01.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:00:01.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:00:01.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:00:01.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:00:01.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:01.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:00:01.098 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:00:01.099 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:01.099 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:00:01.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:00:01.330 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:01.316+0000 7fcbe2cb9a40 -1 Falling back to public interface 2026-02-17T19:00:01.939 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:01.923+0000 7fcbe2cb9a40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:00:02.315 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:00:02.315 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:02.316 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:00:02.316 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:00:02.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:02.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:00:02.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:00:03.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:00:03.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:03.536 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:00:03.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:00:03.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:03.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:00:03.751 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3433680995,v1:127.0.0.1:6811/3433680995] [v2:127.0.0.1:6812/3433680995,v1:127.0.0.1:6813/3433680995] exists,up 08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:00:03.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:00:03.756 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:00:03.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:00:03.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:00:03.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:00:03.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:00:03.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:00:03.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:00:03.759 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:00:03.759 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:00:03.759 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1' 2026-02-17T19:00:03.759 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:00:03.759 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:00:03.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCzupRpgqpmLRAA742PFEduwRzJPKKG+1bCSA== 2026-02-17T19:00:03.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCzupRpgqpmLRAA742PFEduwRzJPKKG+1bCSA=="}' 2026-02-17T19:00:03.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 -i td/divergent-priors/2/new.json 2026-02-17T19:00:03.992 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:00:04.002 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T19:00:04.004 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCzupRpgqpmLRAA742PFEduwRzJPKKG+1bCSA== --osd-uuid 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:00:04.030 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:04.015+0000 7f50cb2f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:04.031 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:04.015+0000 7f50cb2f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:04.032 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:04.015+0000 7f50cb2f9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:04.033 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:04.019+0000 7f50cb2f9a40 -1 bdev(0x555ad5f5a400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:00:04.033 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:04.019+0000 7f50cb2f9a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T19:00:04.703 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T19:00:04.703 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:00:04.703 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:00:04.704 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:00:04.704 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:00:05.011 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:00:05.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:00:05.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:00:05.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:00:05.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:00:05.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:00:05.029 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:05.015+0000 7f9b39033a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:05.031 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:05.015+0000 7f9b39033a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:05.032 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:05.015+0000 7f9b39033a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:05.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:00:05.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:00:05.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:00:05.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:00:05.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:00:05.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:05.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:00:05.234 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:00:05.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:05.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:00:05.362 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:05.347+0000 7f9b39033a40 -1 Falling back to public interface 2026-02-17T19:00:05.453 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:00:05.975 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:05.959+0000 7f9b39033a40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:00:06.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:00:06.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:06.456 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:00:06.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:00:06.457 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:06.457 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:00:06.672 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2598342038,v1:127.0.0.1:6819/2598342038] [v2:127.0.0.1:6820/2598342038,v1:127.0.0.1:6821/2598342038] exists,up 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:00:06.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:00:06.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:00:06.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:00:06.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-17T19:00:06.981 INFO:tasks.workunit.client.0.trial067.stderr:noout is set 2026-02-17T19:00:06.992 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-17T19:00:07.286 INFO:tasks.workunit.client.0.trial067.stderr:noin is set 2026-02-17T19:00:07.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-17T19:00:07.590 INFO:tasks.workunit.client.0.trial067.stderr:nodown is set 2026-02-17T19:00:07.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-17T19:00:07.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T19:00:07.845 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' already exists 2026-02-17T19:00:07.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T19:00:08.855 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-17T19:00:09.162 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 size to 3 2026-02-17T19:00:09.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-17T19:00:09.465 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 min_size to 2 2026-02-17T19:00:09.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-17T19:00:09.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:00:09.476 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:00:09.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:00:09.697 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:00:09.697 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:00:09.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:00:09.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:09.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:00:09.785 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T19:00:09.785 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T19:00:09.785 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T19:00:09.785 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:09.786 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:00:09.869 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T19:00:09.869 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T19:00:09.869 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T19:00:09.870 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:09.870 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:00:09.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T19:00:09.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T19:00:09.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-17T19:00:09.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:09.954 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T19:00:09.954 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:09.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:00:09.955 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T19:00:09.955 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:09.956 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T19:00:09.957 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836485 2026-02-17T19:00:09.957 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T19:00:09.957 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:10.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T19:00:10.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:00:11.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:00:11.178 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:11.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T19:00:11.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:11.397 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T19:00:11.397 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:11.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:00:11.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T19:00:11.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:11.401 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T19:00:11.401 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705668 2026-02-17T19:00:11.401 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T19:00:11.402 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:00:11.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T19:00:11.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:11.619 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T19:00:11.619 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:11.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:00:11.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T19:00:11.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:11.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T19:00:11.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T19:00:11.622 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542147 2026-02-17T19:00:11.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:00:11.846 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T19:00:11.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-17T19:00:11.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:00:11.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:00:11.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:00:11.848 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:00:11.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:00:11.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:00:11.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:00:11.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:00:11.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:00:11.950 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:00:12.158 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:00:12.159 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:00:12.159 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:00:12.159 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:00:12.159 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:12.159 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:00:12.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T19:00:12.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T19:00:12.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T19:00:12.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:12.242 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:00:12.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T19:00:12.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T19:00:12.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-17T19:00:12.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:12.325 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:00:12.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T19:00:12.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T19:00:12.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542150' 2026-02-17T19:00:12.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:12.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T19:00:12.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:12.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:00:12.407 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T19:00:12.407 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:12.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T19:00:12.409 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836487 2026-02-17T19:00:12.409 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T19:00:12.409 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:12.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T19:00:12.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:12.628 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T19:00:12.628 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:12.629 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:00:12.630 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T19:00:12.630 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:12.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T19:00:12.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T19:00:12.632 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705670 2026-02-17T19:00:12.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:00:12.851 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705670 2026-02-17T19:00:12.851 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:00:13.852 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:00:13.853 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:00:14.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705670 2026-02-17T19:00:14.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:00:15.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T19:00:15.072 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:00:15.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-17T19:00:15.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:15.289 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T19:00:15.289 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:15.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:00:15.291 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T19:00:15.291 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:15.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T19:00:15.293 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542150 2026-02-17T19:00:15.293 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T19:00:15.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:00:15.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T19:00:15.512 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:00:15.512 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:15.512 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:15.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:15.797 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:15.797 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:16.008 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:00:16.008 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:16.009 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:16.009 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:16.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:00:16.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:00:16.293 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:00:16.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-17T19:00:16.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-17T19:00:16.494 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:00:16.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-17T19:00:16.504 INFO:tasks.workunit.client.0.trial067.stdout:primary and soon to be divergent is 1 2026-02-17T19:00:16.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-17T19:00:16.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-17T19:00:16.715 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:00:16.716 INFO:tasks.workunit.client.0.trial067.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T19:00:07.996090+0000 0'0 28:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:07:53.895804+0000 0 0 2026-02-17T19:00:16.716 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:00:16.716 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:00:16.716 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-17T19:00:16.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-17T19:00:16.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-17T19:00:16.726 INFO:tasks.workunit.client.0.trial067.stdout:writing initial objects 2026-02-17T19:00:16.726 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-17T19:00:16.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.748 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.748 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.770 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.770 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.881 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.881 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.966 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.966 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:16.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:16.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.022 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.050 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.050 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.127 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.127 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.155 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.155 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.210 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.210 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.342 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.342 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.566 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.566 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.594 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.623 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.623 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.650 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.762 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.762 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.790 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.845 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.845 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.947 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.947 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:17.975 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:17.975 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.003 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.003 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.059 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.059 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.114 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.114 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.198 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.198 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.226 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.226 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.366 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.366 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.394 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.394 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.590 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.590 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.703 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.703 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.784 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.784 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.869 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.869 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:18.978 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:18.978 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.006 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.006 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.062 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.062 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.146 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.146 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.201 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.201 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.230 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.230 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.313 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.313 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T19:00:19.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:19.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:00:19.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-17T19:00:19.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:00:19.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:00:19.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:00:19.483 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:00:19.483 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:00:19.483 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:00:19.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:00:19.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:00:19.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:00:19.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:00:19.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:00:19.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:00:19.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:00:19.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:00:19.554 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:00:19.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:00:19.767 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:00:19.767 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:00:19.767 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:00:19.767 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:19.767 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:00:19.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T19:00:19.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T19:00:19.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T19:00:19.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:19.851 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:00:19.935 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T19:00:19.935 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T19:00:19.935 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T19:00:19.935 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:19.935 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:00:20.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T19:00:20.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T19:00:20.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542153' 2026-02-17T19:00:20.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:20.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T19:00:20.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:20.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:00:20.021 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T19:00:20.021 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:20.023 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T19:00:20.023 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T19:00:20.023 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836491 2026-02-17T19:00:20.023 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:20.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-17T19:00:20.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:00:21.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:00:21.253 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:21.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T19:00:21.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:21.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T19:00:21.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:21.466 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:00:21.467 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T19:00:21.467 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:21.469 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T19:00:21.469 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T19:00:21.469 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705674 2026-02-17T19:00:21.470 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T19:00:21.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:21.699 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T19:00:21.699 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542153 2026-02-17T19:00:21.699 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T19:00:21.700 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:00:21.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T19:00:21.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:00:21.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:21.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:22.216 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:00:22.216 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:22.217 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:22.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:00:22.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:22.432 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:22.432 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:22.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:00:22.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:00:22.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:00:22.716 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-17T19:00:22.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T19:00:22.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T19:00:22.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T19:00:22.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T19:00:22.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-17T19:00:22.939 INFO:tasks.workunit.client.0.trial067.stdout:blackholing osds 0 2 2026-02-17T19:00:22.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-17T19:00:22.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-17T19:00:23.140 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:00:23.140 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T19:00:07.996090+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:07:53.895804+0000 0 0 2026-02-17T19:00:23.140 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:00:23.141 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:00:23.141 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:00:23.151 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:23.152 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-17T19:00:23.152 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:00:23.152 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:00:23.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:00:23.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:23.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:23.153 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:00:23.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T19:00:23.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T19:00:23.207 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:00:23.208 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:00:23.208 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:00:23.213 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:23.215 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:23.216 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:00:23.216 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T19:00:23.216 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T19:00:23.277 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:00:23.277 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:00:23.277 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:00:23.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-17T19:00:23.283 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stdout:writing divergent object 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stdout:create missing divergent object 2026-02-17T19:00:23.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-17T19:00:23.285 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-17T19:00:23.286 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-17T19:00:23.286 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T19:00:23.504 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T19:00:23.504 INFO:tasks.workunit.client.0.trial067.stderr:0 2026-02-17T19:00:23.504 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:00:23.504 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-17T19:00:23.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-17T19:00:23.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T19:00:23.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T19:00:23.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T19:00:23.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T19:00:23.506 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:00:23.508 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.16378/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T19:00:23.568 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T19:00:23.568 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T19:00:23.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:23.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:00:23.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T19:00:23.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok injectdataerr test existing_99 2026-02-17T19:00:23.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-17T19:00:23.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-17T19:00:33.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-17T19:00:33.683 INFO:tasks.workunit.client.0.trial067.stderr:rados: no process found 2026-02-17T19:00:33.683 INFO:tasks.workunit.client.0.trial067.stdout:killing all the osds 2026-02-17T19:00:33.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-17T19:00:33.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-17T19:00:33.896 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:00:33.897 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-17T19:00:23.641732+0000 28'101 28:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:07:53.895804+0000 0 0 2026-02-17T19:00:33.897 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:00:33.897 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:00:33.897 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:00:33.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-17T19:00:33.906 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:00:33.907 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:00:33.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:00:33.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:00:33.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:00:34.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:00:34.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T19:00:34.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-17T19:00:34.264 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already down. 2026-02-17T19:00:34.275 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T19:00:34.275 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-17T19:00:34.544 INFO:tasks.workunit.client.0.trial067.stderr:osd.1 is already down. 2026-02-17T19:00:34.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T19:00:34.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-17T19:00:34.830 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already down. 2026-02-17T19:00:34.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:34.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-17T19:00:35.108 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already out. 2026-02-17T19:00:35.119 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:35.119 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-17T19:00:35.390 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already out. 2026-02-17T19:00:35.399 INFO:tasks.workunit.client.0.trial067.stdout:bringing up non_divergent 0 2 2026-02-17T19:00:35.400 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-17T19:00:35.400 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-17T19:00:35.617 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:00:35.618 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-17T19:00:23.641732+0000 28'101 28:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:07:53.895804+0000 0 0 2026-02-17T19:00:35.618 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:00:35.618 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:00:35.618 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:00:35.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:00:35.631 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:00:35.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:00:35.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:00:35.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:00:35.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:00:35.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:00:35.633 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:00:35.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:00:35.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:00:35.634 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T19:00:35.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:00:35.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:00:35.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:00:35.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:00:35.657 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:35.643+0000 7f4e65788a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:35.658 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:35.643+0000 7f4e65788a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:35.660 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:35.643+0000 7f4e65788a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:35.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:00:35.850 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:00:35.851 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:35.851 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:00:36.054 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:36.039+0000 7f4e65788a40 -1 Falling back to public interface 2026-02-17T19:00:36.075 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:00:36.697 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:36.683+0000 7f4e65788a40 -1 osd.0 28 log_to_monitors true 2026-02-17T19:00:37.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:00:37.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:37.077 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:00:37.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:00:37.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:37.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:00:37.294 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3917453786,v1:127.0.0.1:6801/3917453786] [v2:127.0.0.1:6802/3917453786,v1:127.0.0.1:6803/3917453786] exists,up 8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:00:37.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:00:37.299 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:00:37.300 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:00:37.301 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:00:37.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:00:37.302 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T19:00:37.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:00:37.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:00:37.303 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:00:37.303 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:00:37.316 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:37.299+0000 7f4979dcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:37.318 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:37.303+0000 7f4979dcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:37.319 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:37.303+0000 7f4979dcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:37.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:00:37.690 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:37.675+0000 7f4979dcda40 -1 Falling back to public interface 2026-02-17T19:00:37.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:00:38.330 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:00:38.315+0000 7f4979dcda40 -1 osd.2 28 log_to_monitors true 2026-02-17T19:00:38.724 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:00:38.725 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:00:38.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:00:38.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:00:38.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:00:38.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:00:38.939 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/4084422259,v1:127.0.0.1:6811/4084422259] [v2:127.0.0.1:6812/4084422259,v1:127.0.0.1:6813/4084422259] exists,up 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:00:38.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:00:38.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:00:38.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:00:38.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:38.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-17T19:00:39.184 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already in. 2026-02-17T19:00:39.195 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T19:00:39.195 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-17T19:00:39.465 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already in. 2026-02-17T19:00:39.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:00:39.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-17T19:00:39.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:00:39.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:00:39.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:00:39.476 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:00:39.476 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:00:39.477 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:00:39.477 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:00:39.477 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:00:39.477 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:00:39.540 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:00:39.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:00:39.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:00:39.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:00:39.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:00:39.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:00:39.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:00:39.758 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:00:39.758 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:00:39.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:00:39.758 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:39.759 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:00:39.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T19:00:39.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T19:00:39.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T19:00:39.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:39.843 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:00:39.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:00:39.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:00:39.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:00:39.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:00:39.908 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:00:39.908 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:00:39.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T19:00:39.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T19:00:39.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-17T19:00:39.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:39.987 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T19:00:39.987 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:39.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:00:39.988 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T19:00:39.989 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:39.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T19:00:39.991 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 150323855363 2026-02-17T19:00:39.991 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T19:00:39.991 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:40.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T19:00:40.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:00:41.213 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:00:41.214 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:00:41.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T19:00:41.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:00:41.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-17T19:00:41.432 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:00:41.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:00:41.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-17T19:00:41.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:00:41.434 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T19:00:41.435 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-17T19:00:41.435 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 163208757251 2026-02-17T19:00:41.435 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:00:41.663 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T19:00:41.664 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:00:41.664 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:41.664 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:41.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:00:41.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:41.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:42.175 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:42.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:42.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:42.177 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:42.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:42.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:00:42.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:00:42.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:00:42.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:42.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:42.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:42.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:42.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:42.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:42.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:43.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:43.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:43.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:43.057 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:43.339 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:43.340 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:43.340 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:00:43.340 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:43.340 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:00:43.540 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:43.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:43.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:43.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:43.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:43.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:43.542 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:43.542 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:43.749 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:43.750 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:43.750 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:43.750 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:44.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:44.320 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:44.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:44.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:00:44.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:44.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:00:44.721 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:44.722 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:44.942 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:44.943 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:44.943 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:44.944 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:45.235 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:45.236 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:45.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:45.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:45.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:00:45.531 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:45.531 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:00:46.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:46.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:46.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:46.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:46.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:46.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:46.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:46.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:46.552 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:46.552 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:46.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:46.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:46.838 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:46.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:46.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:46.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:47.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:47.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:47.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:00:47.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:47.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:00:48.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:48.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:48.738 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:48.738 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:48.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:48.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:48.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:48.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:48.956 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:48.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:48.957 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:48.957 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:49.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:49.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:49.253 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:49.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:49.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:49.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:00:49.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:49.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:00:52.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:52.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:52.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:52.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:52.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:52.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:52.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:52.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:00:52.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:00:52.963 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:00:52.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:00:52.964 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:00:53.248 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:00:53.248 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:00:53.249 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:00:53.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:00:53.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:00:53.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:00:53.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:00:53.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:00:59.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:00:59.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:00:59.928 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:00:59.929 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:00:59.929 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:00:59.929 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:00:59.929 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:00:59.929 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:01:00.148 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:01:00.148 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:01:00.149 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:01:00.149 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:01:00.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:01:00.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:01:00.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:01:00.733 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:01:00.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:01:00.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:01:00.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:01:00.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:01:08.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:01:08.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:01:08.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:01:08.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:01:08.253 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:01:08.253 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:01:08.254 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:01:08.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:01:08.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:01:08.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:01:08.535 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:01:08.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:01:08.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:01:08.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:01:08.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "ca425f99-2394-4b30-b472-d0addcb1226f", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:01:09.090827+0000", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:01:09.102 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T18:59:55.723108Z", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T18:59:55.723108Z", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:01:09.104 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.105 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T18:59:55:723106+0000", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 41, 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T18:59:55.804318+0000", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:00:39.500477+0000", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:00:38.508316+0000", 2026-02-17T19:01:09.106 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:00:39.398124+0000", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 9, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:01:09.107 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:00:07.754970+0000", 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 1, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool", 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 0, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:01:09.108 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "off", 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 1, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 1, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 1, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 1, 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:01:09.109 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "28", 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T19:01:09.110 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "selfmanaged", 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 0, 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 0, 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [], 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:01:09.111 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:01:09.112 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "", 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:01:09.113 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 0, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {}, 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "read_balance": { 2026-02-17T19:01:09.114 INFO:tasks.workunit.client.0.trial067.stdout: "score_type": "Fair distribution", 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "score_acting": 2.9900000095367432, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "score_stable": 2.9900000095367432, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_acting": 2, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_stable": 2, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity_weighted": 1, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity": 1, 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity_weighted": 1 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.115 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "8e423ae8-8648-44f2-91ac-03a1be36d0ff", 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:01:09.116 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 35, 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 40, 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 29, 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:01:09.117 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:01:09.118 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.119 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.120 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:01:09.121 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3917453786 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/3917453786", 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/3917453786", 2026-02-17T19:01:09.122 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3917453786", 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3917453786", 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "08adb77f-8e22-41a1-b55d-91125cab5c18", 2026-02-17T19:01:09.123 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 9, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 22, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:01:09.124 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.125 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.126 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:01:09.127 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:01:09.128 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3433680995 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.129 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/3433680995", 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/3433680995", 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3433680995", 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3433680995", 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.130 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1", 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 14, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 38, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:01:09.131 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:01:09.132 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.133 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.134 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:01:09.135 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 4084422259 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/4084422259", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/4084422259", 2026-02-17T19:01:09.136 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4084422259", 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4084422259", 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:00:34.196529+0000", 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:01:09.137 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T18:59:59.525938+0000", 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:00:34.477591+0000", 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:00:02.891752+0000", 2026-02-17T19:01:09.138 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:00:34.765093+0000", 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:00:06.980262+0000", 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:01:09.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:01:09.140 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:01:09.141 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/3917453786,v1:127.0.0.1:6803/3917453786]", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:01:09.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T18:59:56.763549Z", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:01:09.143 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/3917453786,v1:127.0.0.1:6801/3917453786]", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3917453786,v1:127.0.0.1:6807/3917453786]", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3917453786,v1:127.0.0.1:6805/3917453786]", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:01:09.144 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/3433680995,v1:127.0.0.1:6813/3433680995]", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:01:09.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:01:09.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:00:00.441657Z", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:01:09.147 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/3433680995,v1:127.0.0.1:6811/3433680995]", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3433680995,v1:127.0.0.1:6817/3433680995]", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3433680995,v1:127.0.0.1:6815/3433680995]", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:01:09.148 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/4084422259,v1:127.0.0.1:6813/4084422259]", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:01:09.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:01:09.150 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:00:04.582201Z", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/4084422259,v1:127.0.0.1:6811/4084422259]", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4084422259,v1:127.0.0.1:6817/4084422259]", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4084422259,v1:127.0.0.1:6815/4084422259]", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:01:09.151 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.152 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 35 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 39 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 41, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:01:09.153 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:01:09.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:01:09.158 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:01:09.159 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.160 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.161 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 0, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:01:09.162 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stderr:report 17597737 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T18:59:55:804095+0000", 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:01:09.163 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:01:09.164 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 1, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:01:09.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:01:09.166 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 16, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 16, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:01:09.167 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83884, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2104, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 25, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81702, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488916, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036649984, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2154496, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 428864, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 26053, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83663419 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 1, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:01:09.168 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83884, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2104, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 25, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81702, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488916, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036649984, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2154496, 2026-02-17T19:01:09.169 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 428864, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 26053, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83663419 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 1, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:01:09.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:01:09.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1228800, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 153600, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 16, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 16, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:01:09.172 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 150323855369 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 38654705677 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 163208757256 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:01:09.173 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 1, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 3, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:01:04.258464+0000", 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "0": { 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:01:09.174 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 37, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 224, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 313, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:01:09.175 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stdout:writing non-divergent object existing_4 2026-02-17T19:01:09.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:09.312 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:09.312 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:09.312 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:09.312 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:09.312 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:09.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-17T19:01:09.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-17T19:01:09.322 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:01:09.322 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:01:09.322 INFO:tasks.workunit.client.0.trial067.stderr:1000 bytes (1.0 kB) copied, 2.8273e-05 s, 35.4 MB/s 2026-02-17T19:01:09.343 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery 2026-02-17T19:01:09.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-17T19:01:09.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:09.549 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:09.549 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:09.549 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:09.549 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:09.550 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:09.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T19:01:09.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T19:01:09.614 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:01:09.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T19:01:09.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-17T19:01:09.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:01:09.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:01:09.621 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:01:09.621 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:09.622 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:09.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:01:09.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T19:01:09.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T19:01:09.676 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:01:09.682 INFO:tasks.workunit.client.0.trial067.stdout:revive divergent 1 2026-02-17T19:01:09.682 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-17T19:01:09.682 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:09.892 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:09.893 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:09.893 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:09.893 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:09.893 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:09.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-17T19:01:10.224 INFO:tasks.workunit.client.0.trial067.stderr:noup is set 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:01:10.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:01:10.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:01:10.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:01:10.245 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:01:10.246 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:01:10.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:01:10.265 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:10.254+0000 7f4ac1de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:10.267 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:10.254+0000 7f4ac1de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:10.268 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:10.254+0000 7f4ac1de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:10.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T19:01:10.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-17T19:01:10.619 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:10.606+0000 7f4ac1de9a40 -1 Falling back to public interface 2026-02-17T19:01:11.309 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:11.294+0000 7f4ac1de9a40 -1 osd.1 28 log_to_monitors true 2026-02-17T19:01:15.464 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery divergent 2026-02-17T19:01:15.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-17T19:01:15.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:15.668 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:15.668 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:15.669 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:15.669 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:15.669 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:15.680 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:15.681 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:01:15.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-17T19:01:15.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T19:01:15.746 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:01:15.752 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-17T19:01:16.077 INFO:tasks.workunit.client.0.trial067.stderr:noup is unset 2026-02-17T19:01:16.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-17T19:01:16.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:16.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:01:16.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:16.090 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:16.091 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:16.091 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:16.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:16.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:16.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:01:16.306 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 35 up_thru 40 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3917453786,v1:127.0.0.1:6801/3917453786] [v2:127.0.0.1:6802/3917453786,v1:127.0.0.1:6803/3917453786] exists,up 8e423ae8-8648-44f2-91ac-03a1be36d0ff 2026-02-17T19:01:16.307 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:16.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:16.309 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:16.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:16.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:01:16.517 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/2520121885,v1:127.0.0.1:6819/2520121885] [v2:127.0.0.1:6820/2520121885,v1:127.0.0.1:6821/2520121885] exists,up 08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:16.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:16.520 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:16.520 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:16.520 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:16.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:16.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:01:16.728 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/4084422259,v1:127.0.0.1:6811/4084422259] [v2:127.0.0.1:6812/4084422259,v1:127.0.0.1:6813/4084422259] exists,up 0dc27a40-1c5e-47b0-9dc6-f6b5cd2225d1 2026-02-17T19:01:16.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:16.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:16.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:16.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:16.924 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:16.924 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:16.925 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:16.925 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:16.925 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:16.933 INFO:tasks.workunit.client.0.trial067.stdout:wait for peering 2026-02-17T19:01:16.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-17T19:01:16.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:17.152 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:17.152 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:17.152 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:17.152 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:17.153 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:17.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:01:17.191 INFO:tasks.workunit.client.0.trial067.stdout:killing divergent 1 2026-02-17T19:01:17.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-17T19:01:17.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:17.394 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:17.394 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:17.395 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:17.395 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:17.395 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:17.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T19:01:17.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:01:17.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:01:17.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:01:17.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:01:17.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:01:17.513 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:01:17.513 INFO:tasks.workunit.client.0.trial067.stdout:reviving divergent 1 2026-02-17T19:01:17.514 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-17T19:01:17.514 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:17.713 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:17.713 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:00:39.504281+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T05:56:35.462767+0000 0 0 2026-02-17T19:01:17.713 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:17.713 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:17.713 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:17.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T19:01:17.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:01:17.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:17.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:01:17.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:01:17.730 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:01:17.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:01:17.749 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:17.734+0000 7fdd934e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:17.750 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:17.738+0000 7fdd934e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:17.751 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:17.738+0000 7fdd934e5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:17.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T19:01:17.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:17.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:01:17.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:17.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:17.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:17.949 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:17.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:17.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:17.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:01:18.115 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:18.102+0000 7fdd934e5a40 -1 Falling back to public interface 2026-02-17T19:01:18.167 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/2520121885,v1:127.0.0.1:6819/2520121885] [v2:127.0.0.1:6820/2520121885,v1:127.0.0.1:6821/2520121885] exists,up 08adb77f-8e22-41a1-b55d-91125cab5c18 2026-02-17T19:01:18.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:18.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:18.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:18.169 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-17T19:01:18.785 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:18.774+0000 7fdd934e5a40 -1 osd.1 47 log_to_monitors true 2026-02-17T19:01:38.169 INFO:tasks.workunit.client.0.trial067.stdout:allowing recovery 2026-02-17T19:01:38.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-17T19:01:38.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:38.373 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:38.373 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T19:01:19.382584+0000 47'102 51:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:37:10.860762+0000 0 0 2026-02-17T19:01:38.373 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:38.373 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:38.373 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:38.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T19:01:38.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T19:01:38.454 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:01:38.461 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T19:01:38.461 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T19:01:38.534 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:01:38.542 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T19:01:38.542 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T19:01:38.614 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:01:38.624 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-17T19:01:38.624 INFO:tasks.workunit.client.0.trial067.stdout:reading divergent objects 2026-02-17T19:01:38.624 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-17T19:01:38.825 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:01:38.826 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T19:01:19.382584+0000 47'102 51:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:00:07.782747+0000 0'0 2026-02-17T19:00:07.782747+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:37:10.860762+0000 0 0 2026-02-17T19:01:38.826 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:01:38.826 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:01:38.826 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:01:38.836 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-17T19:01:38.838 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-17T19:01:38.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:01:38.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T19:01:38.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:01:38.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T19:01:38.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:01:38.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T19:01:38.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:01:38.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T19:01:38.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-17T19:01:38.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T19:01:38.943 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:01:38.947 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-17T19:00:23.294172+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:01:38.947 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-17T19:00:23.294172+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 28'101 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-17T19:00:23.294172+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:01:38.948 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:01:16.254+0000 7f4aa3d6f640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T19:01:38.949 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T19:01:38.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:01:38.951 INFO:tasks.workunit.client.0.trial067.stdout:success 2026-02-17T19:01:38.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-17T19:01:38.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.jsY5Kb9SPp 2026-02-17T19:01:38.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-17T19:01:38.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T19:01:38.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T19:01:39.217 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' does not exist 2026-02-17T19:01:39.226 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-17T19:01:39.227 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:01:39.227 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:01:39.227 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:01:39.227 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:01:39.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:01:44.544 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:01:44.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:01:44.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:01:44.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:01:44.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:01:44.551 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:01:44.552 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:01:44.552 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:01:44.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:01:44.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:01:44.554 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:01:44.555 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:01:44.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:01:44.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:01:44.556 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:01:44.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:01:44.558 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:01:44.558 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:01:44.576 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:01:44.576 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.576 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.576 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:01:44.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:01:44.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:01:44.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T19:01:44.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T19:01:44.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:01:44.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:01:44.580 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:01:44.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:01:44.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:01:44.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:01:44.583 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:01:44.583 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:01:44.583 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:01:44.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:01:44.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:01:44.585 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:01:44.585 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:01:44.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:01:44.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:01:44.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:01:44.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:01:44.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:01:44.590 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:01:44.590 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:01:44.590 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T19:01:44.591 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:01:44.592 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.592 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.592 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16378 2026-02-17T19:01:44.593 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:01:44.594 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T19:01:44.594 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:01:44.594 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T19:01:44.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-17T19:01:44.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-17T19:01:44.595 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-17T19:01:44.595 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T19:01:44.595 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:01:44.596 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.aMHGKLZdLC 2026-02-17T19:01:44.596 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.aMHGKLZdLC bs=512 count=1 2026-02-17T19:01:44.597 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:01:44.597 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:01:44.597 INFO:tasks.workunit.client.0.trial067.stderr:512 bytes copied, 0.000180525 s, 2.8 MB/s 2026-02-17T19:01:44.597 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.aMHGKLZdLC 2026-02-17T19:01:44.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.aMHGKLZdLC 2026-02-17T19:01:44.598 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-17T19:01:44.598 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T19:01:44.598 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:01:44.599 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.t4c0pgYD2L 2026-02-17T19:01:44.599 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.t4c0pgYD2L bs=1000 count=1 2026-02-17T19:01:44.600 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:01:44.600 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:01:44.600 INFO:tasks.workunit.client.0.trial067.stderr:1000 bytes (1.0 kB) copied, 0.000101288 s, 9.9 MB/s 2026-02-17T19:01:44.600 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.t4c0pgYD2L 2026-02-17T19:01:44.601 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.t4c0pgYD2L 2026-02-17T19:01:44.601 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-17T19:01:44.601 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-17T19:01:44.602 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:01:44.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:01:44.605 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:01:44.605 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T19:01:44.605 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.632 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.633 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:44.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:01:44.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:01:44.666 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:01:44.666 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:01:44.667 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:01:44.667 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:01:44.668 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.669 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.669 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:01:44.669 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:01:44.669 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get fsid 2026-02-17T19:01:44.723 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:01:44.724 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:01:44.725 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:01:44.725 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.725 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.726 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:01:44.726 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:01:44.726 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get mon_host 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T19:01:44.779 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:01:44.898 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:01:44.899 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:44.899 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:44.899 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:44.899 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.899 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:44.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:01:44.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:01:44.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T19:01:44.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-17T19:01:44.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:01:44.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:01:44.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:01:44.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:01:44.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:01:44.926 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:01:44.926 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:01:44.926 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 4e70d649-48ab-4e0b-a014-11e2baa0eb1f' 2026-02-17T19:01:44.926 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:01:44.927 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:01:44.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYu5RpFU4yNxAAJ0OQkY4nKAKwkRS7BUP9jw== 2026-02-17T19:01:44.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYu5RpFU4yNxAAJ0OQkY4nKAKwkRS7BUP9jw=="}' 2026-02-17T19:01:44.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4e70d649-48ab-4e0b-a014-11e2baa0eb1f -i td/divergent-priors/0/new.json 2026-02-17T19:01:45.054 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:45.062 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T19:01:45.064 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYu5RpFU4yNxAAJ0OQkY4nKAKwkRS7BUP9jw== --osd-uuid 4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:01:45.083 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.070+0000 7fb3a388ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:45.085 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.070+0000 7fb3a388ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:45.086 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.074+0000 7fb3a388ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:45.086 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.074+0000 7fb3a388ea40 -1 bdev(0x5614dc2ac400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:01:45.086 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.074+0000 7fb3a388ea40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T19:01:45.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T19:01:45.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:01:45.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:01:45.802 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:01:45.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:01:45.926 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:01:45.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:01:45.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:01:45.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:01:45.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:01:45.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:01:45.956 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.942+0000 7f3575131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:45.958 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.946+0000 7f3575131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:45.959 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:45.946+0000 7f3575131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:46.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:46.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:46.042 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:46.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:46.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:01:46.151 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:01:46.491 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:46.478+0000 7f3575131a40 -1 Falling back to public interface 2026-02-17T19:01:47.153 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:01:47.153 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:47.153 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:01:47.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:01:47.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:47.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:01:47.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:01:47.466 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:47.454+0000 7f3575131a40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:01:48.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:01:48.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:48.263 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:01:48.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:01:48.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:48.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:01:48.477 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2978961690,v1:127.0.0.1:6801/2978961690] [v2:127.0.0.1:6802/2978961690,v1:127.0.0.1:6803/2978961690] exists,up 4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:01:48.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:01:48.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:01:48.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:01:48.483 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:01:48.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:01:48.484 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:01:48.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ac2cb279-3192-436c-9581-658e47b22079' 2026-02-17T19:01:48.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:01:48.495 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAcu5RpdYfVHBAAXWkaiVUspJufjBWtYdHcIA== 2026-02-17T19:01:48.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAcu5RpdYfVHBAAXWkaiVUspJufjBWtYdHcIA=="}' 2026-02-17T19:01:48.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac2cb279-3192-436c-9581-658e47b22079 -i td/divergent-priors/1/new.json 2026-02-17T19:01:48.718 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:01:48.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T19:01:48.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcu5RpdYfVHBAAXWkaiVUspJufjBWtYdHcIA== --osd-uuid ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:01:48.750 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:48.738+0000 7f277e547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:48.751 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:48.738+0000 7f277e547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:48.752 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:48.738+0000 7f277e547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:48.753 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:48.738+0000 7f277e547a40 -1 bdev(0x56202b77e400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T19:01:48.753 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:48.738+0000 7f277e547a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T19:01:49.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T19:01:49.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:01:49.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:01:49.386 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:01:49.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:01:49.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:01:49.682 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:01:49.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:01:49.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:01:49.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:01:49.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:01:49.710 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:49.698+0000 7fc0edc80a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:49.712 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:49.698+0000 7fc0edc80a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:49.713 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:49.698+0000 7fc0edc80a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:49.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:01:49.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:49.901 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:49.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:49.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:01:50.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:01:50.139 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:50.126+0000 7fc0edc80a40 -1 Falling back to public interface 2026-02-17T19:01:50.707 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:50.694+0000 7fc0edc80a40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:01:51.119 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:01:51.120 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:51.120 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:01:51.120 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:01:51.121 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:51.121 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:01:51.339 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3238371378,v1:127.0.0.1:6811/3238371378] [v2:127.0.0.1:6812/3238371378,v1:127.0.0.1:6813/3238371378] exists,up ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-17T19:01:51.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:01:51.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:01:51.345 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:01:51.346 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:01:51.347 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:01:51.347 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:01:51.348 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 123e62b1-3f0f-4972-8624-84df635c475f' 2026-02-17T19:01:51.348 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:01:51.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAfu5Rp0MmvFBAAShnpEADVLJ2YMmS/tvPGdA== 2026-02-17T19:01:51.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAfu5Rp0MmvFBAAShnpEADVLJ2YMmS/tvPGdA=="}' 2026-02-17T19:01:51.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 123e62b1-3f0f-4972-8624-84df635c475f -i td/divergent-priors/2/new.json 2026-02-17T19:01:51.587 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:01:51.598 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T19:01:51.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfu5Rp0MmvFBAAShnpEADVLJ2YMmS/tvPGdA== --osd-uuid 123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:01:51.627 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:51.614+0000 7fc5a694ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:51.628 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:51.614+0000 7fc5a694ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:51.629 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:51.614+0000 7fc5a694ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:51.630 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:51.614+0000 7fc5a694ca40 -1 bdev(0x55bd270ac400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:01:51.630 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:51.618+0000 7fc5a694ca40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T19:01:52.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T19:01:52.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:01:52.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:01:52.242 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:01:52.242 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:01:52.535 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:01:52.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:01:52.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:01:52.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:01:52.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:01:52.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:01:52.564 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:52.549+0000 7fbed6279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:52.566 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:52.553+0000 7fbed6279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:52.567 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:52.553+0000 7fbed6279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:01:52.753 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:01:52.754 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:01:52.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:52.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:01:52.951 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:52.937+0000 7fbed6279a40 -1 Falling back to public interface 2026-02-17T19:01:52.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:01:53.623 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:01:53.609+0000 7fbed6279a40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:01:53.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:01:53.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:53.970 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:01:53.971 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:01:53.971 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:53.971 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:01:54.188 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:01:55.189 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:01:55.190 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:01:55.190 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:01:55.190 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:01:55.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:01:55.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:01:55.403 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3126845550,v1:127.0.0.1:6819/3126845550] [v2:127.0.0.1:6820/3126845550,v1:127.0.0.1:6821/3126845550] exists,up 123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:01:55.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:01:55.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:01:55.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:01:55.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-17T19:01:55.696 INFO:tasks.workunit.client.0.trial067.stderr:noout is set 2026-02-17T19:01:55.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-17T19:01:55.999 INFO:tasks.workunit.client.0.trial067.stderr:noin is set 2026-02-17T19:01:56.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-17T19:01:56.306 INFO:tasks.workunit.client.0.trial067.stderr:nodown is set 2026-02-17T19:01:56.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-17T19:01:56.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T19:01:56.562 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' already exists 2026-02-17T19:01:56.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T19:01:57.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-17T19:01:57.880 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 size to 3 2026-02-17T19:01:57.892 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-17T19:01:58.188 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 min_size to 2 2026-02-17T19:01:58.199 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-17T19:01:58.200 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:01:58.200 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:01:58.428 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:01:58.428 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:01:58.429 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:01:58.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:01:58.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:01:58.429 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:01:58.512 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T19:01:58.512 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T19:01:58.512 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T19:01:58.512 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:01:58.512 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:01:58.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T19:01:58.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T19:01:58.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-17T19:01:58.595 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:01:58.595 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:01:58.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509444 2026-02-17T19:01:58.682 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509444 2026-02-17T19:01:58.682 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-64424509444' 2026-02-17T19:01:58.682 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:01:58.682 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T19:01:58.682 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:01:58.683 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:01:58.684 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T19:01:58.684 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:01:58.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T19:01:58.685 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836484 2026-02-17T19:01:58.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T19:01:58.686 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:01:58.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T19:01:58.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:01:59.915 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:01:59.915 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:00.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-17T19:02:00.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:00.136 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T19:02:00.137 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:00.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:02:00.138 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T19:02:00.138 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:00.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T19:02:00.139 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672964 2026-02-17T19:02:00.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T19:02:00.140 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:02:00.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T19:02:00.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:00.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509444 2026-02-17T19:02:00.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:00.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:02:00.358 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509444 2026-02-17T19:02:00.359 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:00.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509444 2026-02-17T19:02:00.360 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 64424509444 2026-02-17T19:02:00.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2026-02-17T19:02:00.361 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509444 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:02:00.587 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:02:00.588 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:02:00.588 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:02:00.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:02:00.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:02:00.588 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:02:00.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:02:00.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:02:00.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:02:00.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:02:00.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:02:00.693 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:02:00.909 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:02:00.910 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:02:00.910 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:02:00.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:02:00.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:00.910 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:02:00.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T19:02:00.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T19:02:00.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T19:02:00.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:00.990 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:02:01.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T19:02:01.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T19:02:01.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T19:02:01.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:01.072 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:02:01.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509447 2026-02-17T19:02:01.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509447 2026-02-17T19:02:01.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-64424509447' 2026-02-17T19:02:01.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:01.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T19:02:01.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:01.158 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:02:01.159 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T19:02:01.159 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:01.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T19:02:01.161 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836487 2026-02-17T19:02:01.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T19:02:01.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:01.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T19:02:01.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:01.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T19:02:01.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:01.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:02:01.388 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T19:02:01.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:01.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T19:02:01.390 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672966 2026-02-17T19:02:01.391 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T19:02:01.391 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:02:01.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T19:02:01.604 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:01.605 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509447 2026-02-17T19:02:01.605 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:01.605 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:02:01.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509447 2026-02-17T19:02:01.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:01.608 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509447 2026-02-17T19:02:01.608 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 64424509447 2026-02-17T19:02:01.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2026-02-17T19:02:01.609 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:02:01.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509447 -lt 64424509447 2026-02-17T19:02:01.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:02:01.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:01.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:02.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:02:02.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:02.130 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:02.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:02.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:02.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:02.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:02.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:02.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:02:02.344 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:02.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:02.345 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:02.638 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:02:02.638 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:02:02.638 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:02:02.639 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-17T19:02:02.639 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-17T19:02:02.844 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:02.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-17T19:02:02.854 INFO:tasks.workunit.client.0.trial067.stdout:primary and soon to be divergent is 1 2026-02-17T19:02:02.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-17T19:02:02.854 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:02:03.058 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:02:03.058 INFO:tasks.workunit.client.0.trial067.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T19:01:57.515278+0000 0'0 26:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:52:03.031893+0000 0 0 2026-02-17T19:02:03.058 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:02:03.059 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:02:03.059 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:03.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-17T19:02:03.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T19:02:03.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-17T19:02:03.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-17T19:02:03.072 INFO:tasks.workunit.client.0.trial067.stdout:writing initial objects 2026-02-17T19:02:03.072 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-17T19:02:03.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.124 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.124 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.150 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.150 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.206 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.336 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.336 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.357 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.357 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.492 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.492 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.547 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.568 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.568 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.598 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.598 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.725 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.752 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.753 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.782 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.782 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.811 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.811 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.896 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.896 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:03.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:03.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.008 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.009 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.064 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.064 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.119 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.120 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.147 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.148 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.288 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.437 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.437 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.567 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.568 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.596 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.596 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.623 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.623 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.644 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.644 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.671 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.671 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.718 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.718 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.738 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.759 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.759 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:04.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:04.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.008 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.008 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.058 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.059 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.114 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.114 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.143 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.143 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.200 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.200 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.256 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.256 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.418 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.418 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.447 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.447 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T19:02:05.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.aMHGKLZdLC 2026-02-17T19:02:05.738 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:02:05.738 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-17T19:02:05.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:02:05.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:02:05.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:02:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:02:05.809 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:02:05.809 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:02:05.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:02:05.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:02:05.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:02:05.810 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:02:06.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:02:06.025 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:02:06.025 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:02:06.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:02:06.026 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:06.026 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:02:06.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T19:02:06.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T19:02:06.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T19:02:06.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:06.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:02:06.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672969 2026-02-17T19:02:06.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672969 2026-02-17T19:02:06.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-17T19:02:06.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:06.192 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:02:06.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509450 2026-02-17T19:02:06.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509450 2026-02-17T19:02:06.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-64424509450' 2026-02-17T19:02:06.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:06.274 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T19:02:06.274 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:06.275 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:02:06.275 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T19:02:06.275 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T19:02:06.277 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836490 2026-02-17T19:02:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T19:02:06.278 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:06.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T19:02:06.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:02:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:02:07.501 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:07.721 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T19:02:07.722 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:07.722 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672969 2026-02-17T19:02:07.722 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:02:07.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672969 2026-02-17T19:02:07.724 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:07.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672969 2026-02-17T19:02:07.726 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672969 2026-02-17T19:02:07.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-17T19:02:07.726 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:02:07.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672969 2026-02-17T19:02:07.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:07.940 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509450 2026-02-17T19:02:07.940 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:07.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:02:07.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509450 2026-02-17T19:02:07.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:07.943 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509450 2026-02-17T19:02:07.944 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 64424509450 2026-02-17T19:02:07.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2026-02-17T19:02:07.944 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:02:08.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509450 -lt 64424509450 2026-02-17T19:02:08.173 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:02:08.173 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:08.174 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:08.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:08.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:08.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:08.667 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:02:08.668 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:08.668 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:08.668 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:08.955 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:02:08.955 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:02:08.955 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:02:08.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-17T19:02:08.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T19:02:08.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T19:02:08.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T19:02:08.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T19:02:09.167 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-17T19:02:09.167 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-17T19:02:09.168 INFO:tasks.workunit.client.0.trial067.stdout:blackholing osds 0 2 2026-02-17T19:02:09.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:02:09.371 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:02:09.372 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T19:01:57.515278+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:10:54.656404+0000 0 0 2026-02-17T19:02:09.372 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:02:09.372 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:02:09.373 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:09.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:09.383 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-17T19:02:09.383 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:02:09.383 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:02:09.383 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:02:09.383 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:02:09.384 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:02:09.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:02:09.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:02:09.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T19:02:09.440 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:02:09.440 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:02:09.441 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:02:09.446 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:02:09.448 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T19:02:09.501 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:02:09.501 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:02:09.501 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:02:09.506 INFO:tasks.workunit.client.0.trial067.stdout:create new divergent objects 2026-02-17T19:02:09.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-17T19:02:09.507 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-17T19:02:09.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:02:09.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:02:09.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-17T19:02:09.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-17T19:02:09.508 INFO:tasks.workunit.client.0.trial067.stdout:writing divergent objects 2026-02-17T19:02:09.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-17T19:02:09.509 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-17T19:02:09.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T19:02:09.510 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T19:02:09.510 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.t4c0pgYD2L 2026-02-17T19:02:09.510 INFO:tasks.workunit.client.0.trial067.stdout:remove divergent objects 2026-02-17T19:02:09.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-17T19:02:09.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.t4c0pgYD2L 2026-02-17T19:02:09.511 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-17T19:02:09.512 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T19:02:09.512 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-17T19:02:09.513 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-17T19:02:09.514 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T19:02:09.514 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-17T19:02:09.514 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-17T19:02:09.515 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-17T19:02:09.516 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-17T19:02:09.516 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-17T19:02:19.517 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-17T19:02:19.570 INFO:tasks.workunit.client.0.trial067.stderr:rados: no process found 2026-02-17T19:02:19.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-17T19:02:19.571 INFO:tasks.workunit.client.0.trial067.stdout:killing all the osds 2026-02-17T19:02:19.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:02:19.792 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:02:19.792 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T19:01:57.515278+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:10:54.656404+0000 0 0 2026-02-17T19:02:19.792 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:02:19.792 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:02:19.793 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:19.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-17T19:02:19.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:02:19.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:02:19.804 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:02:19.804 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:02:19.804 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:02:19.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:02:19.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T19:02:19.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-17T19:02:20.133 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already down. 2026-02-17T19:02:20.145 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T19:02:20.145 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-17T19:02:20.410 INFO:tasks.workunit.client.0.trial067.stderr:osd.1 is already down. 2026-02-17T19:02:20.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T19:02:20.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-17T19:02:20.695 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already down. 2026-02-17T19:02:20.704 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:20.704 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-17T19:02:20.985 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already out. 2026-02-17T19:02:20.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:20.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-17T19:02:21.270 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already out. 2026-02-17T19:02:21.279 INFO:tasks.workunit.client.0.trial067.stdout:bringing up non_divergent 0 2 2026-02-17T19:02:21.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-17T19:02:21.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:02:21.492 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:02:21.492 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T19:01:57.515278+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:10:54.656404+0000 0 0 2026-02-17T19:02:21.492 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:02:21.492 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:02:21.492 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:02:21.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:02:21.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:02:21.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:02:21.505 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:02:21.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:02:21.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:02:21.505 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T19:02:21.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:02:21.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:02:21.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:02:21.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:02:21.523 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:21.510+0000 7fa9aa239a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:21.525 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:21.510+0000 7fa9aa239a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:21.526 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:21.514+0000 7fa9aa239a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:02:21.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:02:21.736 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:02:21.736 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:02:21.736 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:02:21.736 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:02:21.903 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:21.890+0000 7fa9aa239a40 -1 Falling back to public interface 2026-02-17T19:02:21.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:02:22.527 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:22.514+0000 7fa9aa239a40 -1 osd.0 28 log_to_monitors true 2026-02-17T19:02:22.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:02:22.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:02:22.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:02:22.954 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:02:22.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:02:22.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:02:23.173 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/164872734,v1:127.0.0.1:6801/164872734] [v2:127.0.0.1:6802/164872734,v1:127.0.0.1:6803/164872734] exists,up 4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:02:23.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:02:23.178 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:02:23.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:02:23.180 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:02:23.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:02:23.181 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T19:02:23.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:02:23.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:02:23.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:02:23.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:02:23.198 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:23.186+0000 7f80be850a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:23.199 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:23.186+0000 7f80be850a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:23.200 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:23.186+0000 7f80be850a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:02:23.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:02:23.397 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:02:23.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:02:23.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:02:23.567 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:23.554+0000 7f80be850a40 -1 Falling back to public interface 2026-02-17T19:02:23.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:02:24.250 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:02:24.238+0000 7f80be850a40 -1 osd.2 28 log_to_monitors true 2026-02-17T19:02:24.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:02:24.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:02:24.618 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:02:24.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:02:24.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:02:24.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:02:24.835 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/119087311,v1:127.0.0.1:6811/119087311] [v2:127.0.0.1:6812/119087311,v1:127.0.0.1:6813/119087311] exists,up 123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:02:24.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:02:24.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:02:24.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:02:24.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:24.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-17T19:02:25.082 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already in. 2026-02-17T19:02:25.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:02:25.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-17T19:02:25.388 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already in. 2026-02-17T19:02:25.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:02:25.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-17T19:02:25.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:02:25.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:02:25.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:02:25.398 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:02:25.398 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:02:25.399 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:02:25.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:02:25.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:02:25.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:02:25.459 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:02:25.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:02:25.684 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:02:25.685 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:02:25.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:02:25.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:25.685 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:02:25.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T19:02:25.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T19:02:25.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T19:02:25.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:25.766 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:02:25.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:02:25.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:02:25.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:02:25.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:02:25.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:25.832 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:02:25.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T19:02:25.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T19:02:25.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-17T19:02:25.915 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:25.915 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T19:02:25.915 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:25.916 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:02:25.916 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T19:02:25.917 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:25.918 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T19:02:25.918 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 150323855363 2026-02-17T19:02:25.919 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T19:02:25.919 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:26.146 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T19:02:26.146 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:02:27.147 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:02:27.147 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:27.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T19:02:27.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:27.361 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-17T19:02:27.361 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:27.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:02:27.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-17T19:02:27.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:27.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T19:02:27.364 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 158913789955 2026-02-17T19:02:27.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-17T19:02:27.365 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:02:27.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-17T19:02:27.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:02:27.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:27.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:27.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:27.867 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:28.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:28.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:28.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:28.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:28.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:28.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:02:28.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:02:28.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:02:28.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:28.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:02:28.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:28.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:28.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:28.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:28.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:28.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:28.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:28.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:28.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:28.669 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:28.670 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:28.670 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:28.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:28.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:28.963 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:29.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:29.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:29.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:02:29.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:29.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:02:29.460 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:29.460 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:29.461 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:29.461 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:29.461 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:29.462 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:29.462 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:29.462 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:29.677 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:29.677 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:29.678 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:29.678 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:29.972 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:30.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:30.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:30.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:02:30.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:30.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:02:30.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:30.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:30.661 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:30.661 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:30.661 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:30.661 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:30.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:30.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:30.872 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:30.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:30.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:30.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:31.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:31.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:31.157 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:31.157 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:31.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:31.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:31.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:02:31.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:31.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:02:32.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:32.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:32.251 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:32.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:32.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:32.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:32.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:32.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:32.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:32.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:32.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:32.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:32.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:32.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:32.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:32.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:32.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:32.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:32.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:32.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:32.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:33.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:33.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:33.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:02:33.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:33.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:02:34.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:34.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:34.642 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:34.642 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:34.642 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:34.643 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:34.643 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:34.643 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:34.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:34.849 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:34.850 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:34.850 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:35.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:35.135 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:35.135 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:35.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:35.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:35.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:02:35.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:35.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:02:38.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:38.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:38.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:38.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:38.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:38.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:38.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:38.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:38.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:38.833 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:38.833 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:38.834 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:39.124 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:39.124 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:39.125 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:39.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:39.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:39.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:02:39.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:39.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:02:45.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:45.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:45.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:45.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:45.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:45.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:45.807 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:45.807 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:46.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:46.019 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:46.019 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:46.019 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:46.307 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:46.308 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:46.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:46.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:46.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:02:46.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:46.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:02:53.904 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:53.904 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:53.905 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:54.122 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:54.123 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:54.123 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:54.123 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:02:54.414 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:02:54.415 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:02:54.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:02:54.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:02:54.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:02:54.709 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "939454f4-ae98-4d08-b49a-ace1a1660755", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:02:54.972523+0000", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:02:54.983 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:01:44.612909Z", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:01:44.612909Z", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:02:54.984 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:01:44:612907+0000", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 42, 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:01:44.692263+0000", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:02:25.420783+0000", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:02:24.393938+0000", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:02:25.319054+0000", 2026-02-17T19:02:54.985 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 9, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:01:56.462091+0000", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 0, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "off", 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 1, 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:02:54.986 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "28", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "selfmanaged", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [], 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:02:54.987 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {}, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "read_balance": { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "score_type": "Fair distribution", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "score_acting": 2.9900000095367432, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "score_stable": 2.9900000095367432, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_acting": 2, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_stable": 2, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity_weighted": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity_weighted": 1 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "4e70d649-48ab-4e0b-a014-11e2baa0eb1f", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 35, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 41, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 29, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.988 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/164872734", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/164872734", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/164872734", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/164872734", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:02:54.989 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "ac2cb279-3192-436c-9581-658e47b22079", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 10, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 22, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.990 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/3238371378", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/3238371378", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3238371378", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3238371378", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "123e62b1-3f0f-4972-8624-84df635c475f", 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 15, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 37, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:02:54.991 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:02:54.992 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/119087311", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/119087311", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/119087311", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/119087311", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.063852+0000", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:48.429133+0000", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.343827+0000", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:51.690044+0000", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.628733+0000", 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:02:54.993 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:54.653685+0000", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/164872734,v1:127.0.0.1:6803/164872734]", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:02:54.994 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:45.631199Z", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/164872734,v1:127.0.0.1:6801/164872734]", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/164872734,v1:127.0.0.1:6807/164872734]", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/164872734,v1:127.0.0.1:6805/164872734]", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:02:54.995 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/3238371378,v1:127.0.0.1:6813/3238371378]", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:49.273946Z", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/3238371378,v1:127.0.0.1:6811/3238371378]", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3238371378,v1:127.0.0.1:6817/3238371378]", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3238371378,v1:127.0.0.1:6815/3238371378]", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:02:54.996 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/119087311,v1:127.0.0.1:6813/119087311]", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:52.134044Z", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:02:54.997 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/119087311,v1:127.0.0.1:6811/119087311]", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/119087311,v1:127.0.0.1:6817/119087311]", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/119087311,v1:127.0.0.1:6815/119087311]", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 35 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 40 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 42, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:02:54.998 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:54.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:02:55.000 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:02:55.002 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 0, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stderr:report 2128995841 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:01:44:692044+0000", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:02:55.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 1, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:02:55.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 16, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 16, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:02:55.005 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83896, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2112, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488904, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036637696, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2162688, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 432135, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28010, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661462 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83896, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2112, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:02:55.006 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488904, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036637696, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2162688, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 432135, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28010, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661462 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:02:55.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1220608, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 153552, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 16, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 16, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:02:55.008 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 150323855369 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 42949672972 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 158913789960 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 1, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:02:55.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 3, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:02:53.144749+0000", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "0": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 35, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 218, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 305, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:02:55.010 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stdout:writing non-divergent object existing_4 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-17T19:02:55.011 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:02:55.202 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:02:55.202 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 28'100 42:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:02:55.202 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:02:55.202 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:02:55.203 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:02:55.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.t4c0pgYD2L 2026-02-17T19:02:55.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.t4c0pgYD2L 2026-02-17T19:02:55.244 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:02:55.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-17T19:02:55.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:02:55.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:02:55.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:02:55.245 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:02:55.246 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:02:55.246 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:02:55.246 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:02:55.246 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:02:55.246 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:02:55.302 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:02:55.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:02:55.521 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:02:55.521 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:02:55.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:02:55.522 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:55.522 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:02:55.606 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-17T19:02:55.606 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-17T19:02:55.606 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-17T19:02:55.606 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:55.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:02:55.673 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:02:55.753 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-17T19:02:55.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-17T19:02:55.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-17T19:02:55.754 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:55.754 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-17T19:02:55.755 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:55.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:02:55.755 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-17T19:02:55.755 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:55.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-17T19:02:55.757 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 150323855371 2026-02-17T19:02:55.757 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-17T19:02:55.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:55.979 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-17T19:02:55.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:02:56.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:02:56.981 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:57.198 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-17T19:02:57.198 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:02:58.199 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T19:02:58.199 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:02:58.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-17T19:02:58.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:02:58.420 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789963 2026-02-17T19:02:58.420 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:02:58.421 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:02:58.423 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-17T19:02:58.423 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:02:58.424 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-17T19:02:58.424 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 158913789963 2026-02-17T19:02:58.424 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-17T19:02:58.424 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:02:58.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-17T19:02:58.651 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:02:58.652 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:58.652 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:58.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:58.942 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:59.159 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:59.160 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:59.160 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:59.160 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:02:59.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:02:59.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:02:59.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:02:59.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:02:59.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:02:59.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:02:59.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:02:59.771 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:02:59.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:02:59.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:02:59.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:00.066 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:00.067 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:00.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:00.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:00.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:03:00.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:00.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:03:00.560 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:00.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:00.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:00.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:00.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:00.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:01.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:01.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:01.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:01.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:03:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:03:01.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:01.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:01.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:01.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:01.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:01.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:01.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:01.773 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:01.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:01.997 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:01.997 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:01.997 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:02.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:02.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:02.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:02.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:02.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:02.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:02.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:02.283 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:02.283 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:02.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:02.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:02.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:03:02.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:02.562 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:03.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:03.364 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:03.364 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:03.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:03.578 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:03.579 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:03.579 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:03.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:03.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:03.860 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:03.860 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:04.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:04.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:04.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:03:04.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:04.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:05.739 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:05.740 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:05.958 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:05.959 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:05.959 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:05.959 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:06.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:06.254 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:06.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:06.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:06.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:03:06.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:06.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:03:09.745 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:09.745 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:09.746 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:09.746 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:09.746 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:09.746 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:09.746 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:09.747 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:09.955 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:09.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:09.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:09.956 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:10.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:10.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:10.234 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:10.522 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:10.523 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:10.523 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:03:10.523 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:10.523 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:03:16.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:16.924 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:16.925 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:17.136 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:17.137 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:17.137 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:17.137 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:17.419 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:17.420 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:03:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:03:17.709 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:03:25.009 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:03:25.009 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:03:25.010 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:03:25.010 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:03:25.010 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:03:25.011 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:03:25.011 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:03:25.011 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:03:25.230 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:03:25.231 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:03:25.231 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:03:25.231 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:03:25.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:03:25.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:03:25.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:03:25.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:03:25.526 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:03:25.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:03:25.527 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:03:25.527 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:03:25.527 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:03:25.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:03:25.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:03:25.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:03:25.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "939454f4-ae98-4d08-b49a-ace1a1660755", 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:03:26.089450+0000", 2026-02-17T19:03:26.100 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:03:26.101 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.102 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.103 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:01:44.612909Z", 2026-02-17T19:03:26.104 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:01:44.612909Z", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:03:26.105 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:03:26.106 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.107 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:01:44:612907+0000", 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.108 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 42, 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:01:44.692263+0000", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:02:25.420783+0000", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:02:24.393938+0000", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:02:25.319054+0000", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:03:26.109 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 9, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:03:26.110 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:01:56.462091+0000", 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 1, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool", 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:03:26.111 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 0, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "off", 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 1, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 1, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 1, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 1, 2026-02-17T19:03:26.112 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "28", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "selfmanaged", 2026-02-17T19:03:26.113 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [], 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:03:26.114 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "", 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:03:26.115 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 0, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {}, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "read_balance": { 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "score_type": "Fair distribution", 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "score_acting": 2.9900000095367432, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "score_stable": 2.9900000095367432, 2026-02-17T19:03:26.116 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_acting": 2, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_stable": 2, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity_weighted": 1, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity": 1, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity_weighted": 1 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "4e70d649-48ab-4e0b-a014-11e2baa0eb1f", 2026-02-17T19:03:26.117 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 35, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 41, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 29, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.118 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:03:26.119 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.120 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.121 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 164872734 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.122 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/164872734", 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/164872734", 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/164872734", 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/164872734", 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:03:26.123 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "ac2cb279-3192-436c-9581-658e47b22079", 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 10, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 22, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.124 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:03:26.125 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.126 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.127 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 3238371378 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.128 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/3238371378", 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/3238371378", 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3238371378", 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3238371378", 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "123e62b1-3f0f-4972-8624-84df635c475f", 2026-02-17T19:03:26.129 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 15, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 37, 2026-02-17T19:03:26.130 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.131 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.132 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.133 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.134 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.135 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 119087311 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/119087311", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/119087311", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/119087311", 2026-02-17T19:03:26.136 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/119087311", 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.063852+0000", 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:03:26.137 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:48.429133+0000", 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.343827+0000", 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:51.690044+0000", 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.138 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:02:20.628733+0000", 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:01:54.653685+0000", 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:03:26.139 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:03:26.140 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/164872734,v1:127.0.0.1:6803/164872734]", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:03:26.141 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.142 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:45.631199Z", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/164872734,v1:127.0.0.1:6801/164872734]", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/164872734,v1:127.0.0.1:6807/164872734]", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/164872734,v1:127.0.0.1:6805/164872734]", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:03:26.143 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/3238371378,v1:127.0.0.1:6813/3238371378]", 2026-02-17T19:03:26.144 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:03:26.145 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:49.273946Z", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/3238371378,v1:127.0.0.1:6811/3238371378]", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3238371378,v1:127.0.0.1:6817/3238371378]", 2026-02-17T19:03:26.146 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3238371378,v1:127.0.0.1:6815/3238371378]", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.147 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/119087311,v1:127.0.0.1:6813/119087311]", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:03:26.148 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:01:52.134044Z", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/119087311,v1:127.0.0.1:6811/119087311]", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:03:26.149 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/119087311,v1:127.0.0.1:6817/119087311]", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/119087311,v1:127.0.0.1:6815/119087311]", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:03:26.150 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 35 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 40 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 42, 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.151 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:03:26.152 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.153 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.154 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:03:26.155 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.156 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.157 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.158 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:03:26.159 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 0, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stderr:report 1630089775 2026-02-17T19:03:26.160 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:01:44:692044+0000", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.161 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 1, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51688, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:03:26.162 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:03:26.163 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 17, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 17, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:03:26.164 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83896, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2112, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488904, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036637696, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2162688, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 433111, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28010, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661462 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:03:26.165 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83896, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2112, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488904, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036637696, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2162688, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 433111, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28010, 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661462 2026-02-17T19:03:26.166 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51688, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:03:26.167 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:03:26.168 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1220608, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 154528, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 17, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 17, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "up": 2, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 2, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 150323855377 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:03:26.169 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 42949672972 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 158913789969 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 1, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.170 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 5, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:03:25.148263+0000", 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "services": {} 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 51, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 283, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 386, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:03:26.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:03:26.172 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery 2026-02-17T19:03:26.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-17T19:03:26.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:26.321 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:26.321 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 42:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:26.322 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:26.322 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:26.322 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:26.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:03:26.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-17T19:03:26.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:03:26.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:03:26.333 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:03:26.333 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:26.333 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:26.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:03:26.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:03:26.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T19:03:26.400 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:03:26.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T19:03:26.407 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-17T19:03:26.407 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:03:26.407 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:03:26.407 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:03:26.408 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:26.408 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:26.408 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:03:26.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:03:26.409 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T19:03:26.463 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:03:26.469 INFO:tasks.workunit.client.0.trial067.stdout:revive divergent 1 2026-02-17T19:03:26.469 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-17T19:03:26.469 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:26.683 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:26.683 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 42:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:26.683 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:26.683 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:26.683 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:26.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-17T19:03:27.012 INFO:tasks.workunit.client.0.trial067.stderr:noup is set 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:03:27.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:03:27.029 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:03:27.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:03:27.031 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:03:27.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:03:27.053 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:27.042+0000 7fbf6095fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:27.054 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:27.042+0000 7fbf6095fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:27.055 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:27.042+0000 7fbf6095fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:27.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T19:03:27.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-17T19:03:27.458 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:27.446+0000 7fbf6095fa40 -1 Falling back to public interface 2026-02-17T19:03:28.176 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:28.162+0000 7fbf6095fa40 -1 osd.1 28 log_to_monitors true 2026-02-17T19:03:32.253 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery divergent 2026-02-17T19:03:32.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-17T19:03:32.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:32.453 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:32.454 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 44:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:32.454 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:32.454 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:32.454 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:32.465 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-17T19:03:32.465 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:03:32.465 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:03:32.466 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T19:03:32.525 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:03:32.531 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-17T19:03:32.857 INFO:tasks.workunit.client.0.trial067.stderr:noup is unset 2026-02-17T19:03:32.872 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:03:32.873 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:03:32.874 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:03:32.874 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:03:32.874 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:03:33.091 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 35 up_thru 41 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/164872734,v1:127.0.0.1:6801/164872734] [v2:127.0.0.1:6802/164872734,v1:127.0.0.1:6803/164872734] exists,up 4e70d649-48ab-4e0b-a014-11e2baa0eb1f 2026-02-17T19:03:33.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:03:33.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:03:33.093 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:03:33.094 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:03:33.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:03:33.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:03:33.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:03:33.308 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 47 up_thru 47 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/514891014,v1:127.0.0.1:6819/514891014] [v2:127.0.0.1:6820/514891014,v1:127.0.0.1:6821/514891014] exists,up ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:03:33.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:03:33.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:03:33.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:03:33.311 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:03:33.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:03:33.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:03:33.311 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:03:33.530 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/119087311,v1:127.0.0.1:6811/119087311] [v2:127.0.0.1:6812/119087311,v1:127.0.0.1:6813/119087311] exists,up 123e62b1-3f0f-4972-8624-84df635c475f 2026-02-17T19:03:33.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:03:33.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:03:33.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:03:33.530 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:33.736 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:33.736 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 45:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:33.736 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:33.736 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:33.737 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:33.746 INFO:tasks.workunit.client.0.trial067.stdout:wait for peering 2026-02-17T19:03:33.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-17T19:03:33.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:33.959 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:33.960 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 45:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:33.960 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:33.960 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:33.960 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:33.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.aMHGKLZdLC 2026-02-17T19:03:33.992 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.aMHGKLZdLC 2026-02-17T19:03:33.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-17T19:03:33.994 INFO:tasks.workunit.client.0.trial067.stdout:killing divergent 1 2026-02-17T19:03:33.994 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:34.197 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:34.197 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 45:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:34.197 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:34.197 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:34.198 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:34.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T19:03:34.208 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:03:34.208 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:03:34.208 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:03:34.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:03:34.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:03:34.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:03:34.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.16378.out 2026-02-17T19:03:34.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16378.out 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T19:03:34.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16378.out 2026-02-17T19:03:34.501 INFO:tasks.workunit.client.0.trial067.stderr:Exporting 1.0 info 1.0( v 48'102 lc 0'0 (28'90,48'102] local-lis/les=47/48 n=101 ec=22/22 lis/c=47/22 les/c/f=48/23/0 sis=47) 2026-02-17T19:03:34.519 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:169157fa:::existing_81:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:17731382:::existing_58:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-17T19:03:34.520 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:28566edb:::existing_78:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:2a101182:::existing_20:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-17T19:03:34.521 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:53588912:::existing_9:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:602f83fe:::foo:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:628918ca:::existing_79:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-17T19:03:34.522 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:750ace21:::existing_19:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:79881152:::existing_63:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:81490677:::existing_76:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-17T19:03:34.523 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:92731e71:::existing_89:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:928205cf:::existing_82:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:93be2267:::existing_24:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a504a533:::existing_90:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a691337e:::existing_61:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-17T19:03:34.524 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:b343e277:::existing_88:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:bebec877:::existing_74:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:c156033e:::existing_100:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-17T19:03:34.525 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:e255b710:::existing_55:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-17T19:03:34.526 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:f6809456:::existing_11:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-17T19:03:34.527 INFO:tasks.workunit.client.0.trial067.stderr:Export successful 2026-02-17T19:03:34.528 INFO:tasks.workunit.client.0.trial067.stdout: marking collection for removal 2026-02-17T19:03:34.528 INFO:tasks.workunit.client.0.trial067.stdout:setting '_remove' omap key 2026-02-17T19:03:34.528 INFO:tasks.workunit.client.0.trial067.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T19:03:34.528 INFO:tasks.workunit.client.0.trial067.stderr:Remove successful 2026-02-17T19:03:34.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16378.out 2026-02-17T19:03:34.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:03:34.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:03:34.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T19:03:34.597 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:03:34.598 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T19:03:34.598 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16378.out 2026-02-17T19:03:34.785 INFO:tasks.workunit.client.0.trial067.stdout:get_pg_num_history pg_num_history pg_num_history(e48 pg_nums {1={22=1}} deleted_pools ) 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:Importing pgid 1.0 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-17T19:03:34.786 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:169157fa:::existing_81:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:17731382:::existing_58:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-17T19:03:34.787 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:28566edb:::existing_78:head# 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.788 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:2a101182:::existing_20:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.789 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:53588912:::existing_9:head# 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.790 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:602f83fe:::foo:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:628918ca:::existing_79:head# 2026-02-17T19:03:34.791 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-17T19:03:34.792 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-17T19:03:34.799 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:750ace21:::existing_19:head# 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:79881152:::existing_63:head# 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.800 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:81490677:::existing_76:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:92731e71:::existing_89:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:928205cf:::existing_82:head# 2026-02-17T19:03:34.801 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:93be2267:::existing_24:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-17T19:03:34.802 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a504a533:::existing_90:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a691337e:::existing_61:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-17T19:03:34.803 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:b343e277:::existing_88:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.804 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:bebec877:::existing_74:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:c156033e:::existing_100:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.805 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-17T19:03:34.806 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:e255b710:::existing_55:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.807 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:f6809456:::existing_11:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-17T19:03:34.808 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:03:34.809 INFO:tasks.workunit.client.0.trial067.stdout:write_pg epoch 48 info 1.0( v 48'102 lc 0'0 (28'90,48'102] local-lis/les=47/48 n=101 ec=22/22 lis/c=47/22 les/c/f=48/23/0 sis=47) 2026-02-17T19:03:34.809 INFO:tasks.workunit.client.0.trial067.stdout:Import successful 2026-02-17T19:03:34.889 INFO:tasks.workunit.client.0.trial067.stdout:reviving divergent 1 2026-02-17T19:03:34.890 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-17T19:03:34.890 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:35.092 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:35.093 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:02:41.221194+0000 42'101 45:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:00:29.707000+0000 0 0 2026-02-17T19:03:35.093 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:35.093 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:35.093 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:35.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T19:03:35.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:03:35.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:03:35.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:03:35.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:03:35.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:03:35.107 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:03:35.108 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:03:35.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:03:35.132 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:35.118+0000 7fc7c8024a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:35.133 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:35.122+0000 7fc7c8024a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:35.134 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:35.122+0000 7fc7c8024a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:03:35.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T19:03:35.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:03:35.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:03:35.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:03:35.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:03:35.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:03:35.331 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:03:35.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:03:35.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:03:35.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:03:35.502 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:35.490+0000 7fc7c8024a40 -1 Falling back to public interface 2026-02-17T19:03:35.548 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 47 up_thru 47 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/514891014,v1:127.0.0.1:6819/514891014] [v2:127.0.0.1:6820/514891014,v1:127.0.0.1:6821/514891014] exists,up ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:03:35.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:03:35.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:03:35.551 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:03:35.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:03:35.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:03:35.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:03:35.768 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 47 up_thru 47 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/514891014,v1:127.0.0.1:6819/514891014] [v2:127.0.0.1:6820/514891014,v1:127.0.0.1:6821/514891014] exists,up ac2cb279-3192-436c-9581-658e47b22079 2026-02-17T19:03:35.769 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:03:35.769 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:03:35.769 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:03:35.769 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-17T19:03:36.232 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:03:36.218+0000 7fc7c8024a40 -1 osd.1 48 log_to_monitors true 2026-02-17T19:03:55.770 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-17T19:03:55.771 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:03:55.771 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-17T19:03:55.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T19:03:55.834 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:03:55.834 INFO:tasks.workunit.client.0.trial067.stdout: "ops": [], 2026-02-17T19:03:55.834 INFO:tasks.workunit.client.0.trial067.stdout: "num_ops": 0 2026-02-17T19:03:55.834 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:03:55.840 INFO:tasks.workunit.client.0.trial067.stdout:allowing recovery 2026-02-17T19:03:55.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-17T19:03:55.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:56.049 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:56.050 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T19:03:37.238327+0000 48'102 52:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:19:39.787407+0000 0 0 2026-02-17T19:03:56.050 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:56.050 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:56.051 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:56.058 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T19:03:56.058 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T19:03:56.145 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:03:56.152 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T19:03:56.152 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T19:03:56.234 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:03:56.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T19:03:56.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T19:03:56.321 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:03:56.328 INFO:tasks.workunit.client.0.trial067.stdout:reading divergent objects 2026-02-17T19:03:56.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-17T19:03:56.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-17T19:03:56.544 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:03:56.544 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T19:03:37.238327+0000 48'102 52:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:01:56.495655+0000 0'0 2026-02-17T19:01:56.495655+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:19:39.787407+0000 0 0 2026-02-17T19:03:56.544 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:03:56.544 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:03:56.544 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:03:56.555 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-17T19:03:56.557 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-17T19:03:56.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:03:56.557 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T19:03:56.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:03:56.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T19:03:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:03:56.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T19:03:56.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:03:56.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T19:03:56.674 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-17T19:03:56.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:03:56.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T19:03:56.695 INFO:tasks.workunit.client.0.trial067.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T19:03:56.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:03:56.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T19:03:56.722 INFO:tasks.workunit.client.0.trial067.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T19:03:56.724 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-17T19:03:56.725 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T19:03:56.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'105 (28'4) delete 1:70b3bf12:::existing_4:head by client.4544.0:1 2026-02-17T19:02:09.523652+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'105 (28'4) delete 1:70b3bf12:::existing_4:head by client.4544.0:1 2026-02-17T19:02:09.523652+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: more recent entry found: 42'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4654.0:1 2026-02-17T19:02:55.230138+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4532.0:1 2026-02-17T19:02:09.515648+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4532.0:1 2026-02-17T19:02:09.515648+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:03:56.729 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-17T19:02:09.524099+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-17T19:02:09.524099+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:03:56.730 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4545.0:1 2026-02-17T19:02:09.524099+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T19:02:09.518723+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T19:02:09.518723+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:03:56.731 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-17T19:03:56.732 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T19:02:09.518723+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.732 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T19:03:56.732 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-17T19:03:56.732 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-17T19:02:09.521221+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.732 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-17T19:02:09.521221+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4539.0:1 2026-02-17T19:02:09.521221+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T19:03:56.733 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-17T19:02:09.516676+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-17T19:02:09.516676+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T19:03:56.734 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:03:33.630+0000 7fbf3e8dd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T19:03:56.735 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T19:03:56.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:03:56.735 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T19:03:56.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:03:56.738 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-17T19:03:56.738 INFO:tasks.workunit.client.0.trial067.stdout:success 2026-02-17T19:03:56.739 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.16378.out 2026-02-17T19:03:56.740 INFO:tasks.workunit.client.0.trial067.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16378.out': No such file or directory 2026-02-17T19:03:56.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-17T19:03:56.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T19:03:56.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T19:03:56.995 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' does not exist 2026-02-17T19:03:57.004 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-17T19:03:57.005 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:03:57.005 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:03:57.005 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:03:57.005 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:03:57.005 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:04:02.320 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:04:02.321 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:04:02.322 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:04:02.322 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:04:02.322 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:04:02.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:04:02.328 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:04:02.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:04:02.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:04:02.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:04:02.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:04:02.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:04:02.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:04:02.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:04:02.333 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:04:02.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:04:02.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:04:02.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:04:02.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:04:02.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:04:02.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.357 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:04:02.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:04:02.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:04:02.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:04:02.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:04:02.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:04:02.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:04:02.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:04:02.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:04:02.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:04:02.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:04:02.365 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:04:02.366 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:04:02.366 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:04:02.366 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:04:02.367 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:04:02.367 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:04:02.368 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:04:02.368 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:04:02.370 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:04:02.370 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.370 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:04:02.371 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:04:02.371 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:04:02.371 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T19:04:02.372 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:04:02.372 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.373 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16378 2026-02-17T19:04:02.374 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:04:02.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T19:04:02.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:04:02.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T19:04:02.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.BKNFLz58nW 2026-02-17T19:04:02.376 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.BKNFLz58nW bs=512 count=1 2026-02-17T19:04:02.377 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:04:02.377 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:04:02.377 INFO:tasks.workunit.client.0.trial067.stderr:512 bytes copied, 5.5073e-05 s, 9.3 MB/s 2026-02-17T19:04:02.378 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:02.378 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.BKNFLz58nW 2026-02-17T19:04:02.378 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-17T19:04:02.378 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T19:04:02.379 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:04:02.380 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.3HSB6N9oRd 2026-02-17T19:04:02.380 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.3HSB6N9oRd bs=1000 count=1 2026-02-17T19:04:02.381 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:04:02.381 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:04:02.381 INFO:tasks.workunit.client.0.trial067.stderr:1000 bytes (1.0 kB) copied, 8.0331e-05 s, 12.4 MB/s 2026-02-17T19:04:02.381 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.3HSB6N9oRd 2026-02-17T19:04:02.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.3HSB6N9oRd 2026-02-17T19:04:02.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-17T19:04:02.382 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-17T19:04:02.383 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-17T19:04:02.384 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T19:04:02.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.408 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:02.409 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:04:02.439 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:04:02.440 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:04:02.441 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:04:02.441 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:04:02.441 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:04:02.441 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:04:02.442 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:04:02.442 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:04:02.442 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:04:02.442 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:04:02.443 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.443 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.443 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:04:02.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:04:02.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get fsid 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:04:02.499 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:04:02.500 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:04:02.501 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get mon_host 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T19:04:02.556 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:04:02.674 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.675 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:02.676 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:04:02.676 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:04:02.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:02.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:04:02.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:04:02.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:04:02.698 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:04:02.698 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 662f1b06-4ff5-40a4-880c-d75c6f2efcd8' 2026-02-17T19:04:02.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:04:02.711 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCiu5Rp8lrNKRAA6WtYGKkt0rq3LtHw2lnVIA== 2026-02-17T19:04:02.712 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCiu5Rp8lrNKRAA6WtYGKkt0rq3LtHw2lnVIA=="}' 2026-02-17T19:04:02.712 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 -i td/divergent-priors/0/new.json 2026-02-17T19:04:02.828 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:02.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T19:04:02.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCiu5Rp8lrNKRAA6WtYGKkt0rq3LtHw2lnVIA== --osd-uuid 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:04:02.856 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:02.846+0000 7f00985fca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:02.858 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:02.846+0000 7f00985fca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:02.858 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:02.846+0000 7f00985fca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:02.859 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:02.846+0000 7f00985fca40 -1 bdev(0x55b4dfc5a400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:04:02.859 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:02.846+0000 7f00985fca40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T19:04:03.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T19:04:03.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:04:03.585 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:04:03.586 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:04:03.586 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:04:03.709 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:04:03.709 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:04:03.710 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:04:03.710 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:04:03.710 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:04:03.710 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:04:03.740 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:03.726+0000 7f26aad57a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:03.742 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:03.730+0000 7f26aad57a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:03.743 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:03.730+0000 7f26aad57a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:03.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:04:03.820 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:03.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:03.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:04:03.929 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:04.194 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:04.182+0000 7f26aad57a40 -1 Falling back to public interface 2026-02-17T19:04:04.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:04.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:04.932 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:04.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:04:04.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:04.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:04:05.044 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:05.169 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:05.158+0000 7f26aad57a40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:04:06.046 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:06.046 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:06.047 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:04:06.047 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:04:06.047 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:06.048 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:04:06.271 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1256371573,v1:127.0.0.1:6801/1256371573] [v2:127.0.0.1:6802/1256371573,v1:127.0.0.1:6803/1256371573] exists,up 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:04:06.275 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:04:06.276 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:06.277 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:04:06.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:04:06.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:04:06.280 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:04:06.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1b34b3d7-c7bf-493f-9741-d4eef44112e5' 2026-02-17T19:04:06.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:04:06.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCmu5RpisuoEBAAuRLgUaErcZms/yV5BK1BBg== 2026-02-17T19:04:06.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCmu5RpisuoEBAAuRLgUaErcZms/yV5BK1BBg=="}' 2026-02-17T19:04:06.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1b34b3d7-c7bf-493f-9741-d4eef44112e5 -i td/divergent-priors/1/new.json 2026-02-17T19:04:06.514 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:06.522 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T19:04:06.523 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmu5RpisuoEBAAuRLgUaErcZms/yV5BK1BBg== --osd-uuid 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:04:06.544 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:06.534+0000 7f531ad56a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:06.546 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:06.534+0000 7f531ad56a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:06.547 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:06.534+0000 7f531ad56a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:06.548 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:06.534+0000 7f531ad56a40 -1 bdev(0x561f30eaa400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T19:04:06.548 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:06.534+0000 7f531ad56a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T19:04:07.206 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T19:04:07.206 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:04:07.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:04:07.207 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:04:07.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:04:07.500 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:04:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:04:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:04:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:04:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:04:07.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:04:07.531 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:07.518+0000 7f0de97bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:07.533 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:07.522+0000 7f0de97bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:07.534 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:07.522+0000 7f0de97bca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:07.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:04:07.724 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:07.724 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:07.724 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:04:07.926 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:07.914+0000 7f0de97bca40 -1 Falling back to public interface 2026-02-17T19:04:07.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:08.566 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:08.554+0000 7f0de97bca40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:04:08.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:08.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:08.940 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:08.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:04:08.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:08.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:04:09.167 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:10.169 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:10.169 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:10.170 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:04:10.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:04:10.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:10.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:04:10.381 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/746596475,v1:127.0.0.1:6811/746596475] [v2:127.0.0.1:6812/746596475,v1:127.0.0.1:6813/746596475] exists,up 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:04:10.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:04:10.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:04:10.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:04:10.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:10.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:04:10.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:04:10.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:04:10.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:04:10.389 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:04:10.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 28d024e8-0402-4692-b6cb-b82a48229f95' 2026-02-17T19:04:10.390 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:04:10.401 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCqu5RpkztKFxAAZI6wDwrq+kxO1FVk/JinfQ== 2026-02-17T19:04:10.401 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCqu5RpkztKFxAAZI6wDwrq+kxO1FVk/JinfQ=="}' 2026-02-17T19:04:10.401 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 28d024e8-0402-4692-b6cb-b82a48229f95 -i td/divergent-priors/2/new.json 2026-02-17T19:04:10.621 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:04:10.632 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T19:04:10.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCqu5RpkztKFxAAZI6wDwrq+kxO1FVk/JinfQ== --osd-uuid 28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:04:10.660 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:10.650+0000 7f22179f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:10.662 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:10.650+0000 7f22179f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:10.663 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:10.650+0000 7f22179f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:10.663 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:10.650+0000 7f22179f2a40 -1 bdev(0x562b3a3b6400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:04:10.664 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:10.650+0000 7f22179f2a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T19:04:11.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T19:04:11.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:04:11.344 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:04:11.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:04:11.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:04:11.647 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:04:11.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:04:11.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:04:11.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:04:11.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:04:11.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:04:11.665 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:11.654+0000 7fc1dc248a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:11.667 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:11.654+0000 7fc1dc248a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:11.667 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:11.654+0000 7fc1dc248a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:11.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:04:11.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:04:11.867 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:11.868 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:11.868 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:04:12.042 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:12.030+0000 7fc1dc248a40 -1 Falling back to public interface 2026-02-17T19:04:12.081 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:12.726 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:12.714+0000 7fc1dc248a40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:04:13.083 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:13.083 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:13.083 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:04:13.083 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:13.084 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:13.084 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:04:13.303 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:14.305 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:14.305 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:14.306 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:04:14.306 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:04:14.306 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:14.306 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:04:14.520 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/38754712,v1:127.0.0.1:6819/38754712] [v2:127.0.0.1:6820/38754712,v1:127.0.0.1:6821/38754712] exists,up 28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:04:14.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:04:14.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:04:14.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:04:14.521 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-17T19:04:14.812 INFO:tasks.workunit.client.0.trial067.stderr:noout is set 2026-02-17T19:04:14.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-17T19:04:15.115 INFO:tasks.workunit.client.0.trial067.stderr:noin is set 2026-02-17T19:04:15.128 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-17T19:04:15.419 INFO:tasks.workunit.client.0.trial067.stderr:nodown is set 2026-02-17T19:04:15.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-17T19:04:15.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T19:04:15.676 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' already exists 2026-02-17T19:04:15.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T19:04:16.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-17T19:04:17.000 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 size to 3 2026-02-17T19:04:17.013 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-17T19:04:17.304 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 min_size to 2 2026-02-17T19:04:17.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-17T19:04:17.610 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 pg_autoscale_mode to on 2026-02-17T19:04:17.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-17T19:04:17.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-17T19:04:17.621 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771355057 2026-02-17T19:04:17.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-17T19:04:17.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-17T19:04:17.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-17T19:04:17.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:04:17.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:04:17.848 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:04:17.849 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:04:17.849 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:04:17.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:04:17.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:17.849 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:04:17.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-17T19:04:17.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-17T19:04:17.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T19:04:17.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:17.933 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:04:18.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T19:04:18.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T19:04:18.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705668' 2026-02-17T19:04:18.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:18.016 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705668 2-55834574851' 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-17T19:04:18.097 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:18.099 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:04:18.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-17T19:04:18.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:18.101 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-17T19:04:18.101 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836486 2026-02-17T19:04:18.101 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T19:04:18.101 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:18.316 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-17T19:04:18.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:04:19.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:04:19.319 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:19.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-17T19:04:19.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:19.538 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T19:04:19.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:19.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:04:19.540 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T19:04:19.540 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:19.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T19:04:19.542 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705668 2026-02-17T19:04:19.542 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T19:04:19.542 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:04:19.769 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T19:04:19.770 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:19.770 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-17T19:04:19.770 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:19.771 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:04:19.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-17T19:04:19.772 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:19.773 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T19:04:19.774 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 55834574851 2026-02-17T19:04:19.774 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T19:04:19.774 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:19.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574851 2026-02-17T19:04:19.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-17T19:04:19.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:04:19.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:04:19.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:04:19.998 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:04:19.998 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:04:19.999 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:04:19.999 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:04:19.999 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:04:19.999 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:04:20.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:04:20.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:04:20.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:04:20.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:04:20.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:04:20.107 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:04:20.322 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:04:20.322 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:04:20.323 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:04:20.323 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:04:20.323 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:20.323 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:04:20.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T19:04:20.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T19:04:20.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T19:04:20.406 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:20.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:04:20.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-17T19:04:20.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-17T19:04:20.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705671' 2026-02-17T19:04:20.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:20.488 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:04:20.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705671 2-55834574854' 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:20.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:04:20.575 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T19:04:20.575 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:20.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T19:04:20.577 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836488 2026-02-17T19:04:20.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T19:04:20.577 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:20.790 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-17T19:04:20.790 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:04:21.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:04:21.792 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:22.012 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T19:04:22.013 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:22.013 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-17T19:04:22.013 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:22.014 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:04:22.015 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-17T19:04:22.015 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:22.017 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-17T19:04:22.017 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-17T19:04:22.017 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705671 2026-02-17T19:04:22.017 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:04:22.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-17T19:04:22.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:22.229 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-17T19:04:22.229 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:22.230 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:04:22.231 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-17T19:04:22.231 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:22.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-17T19:04:22.233 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 55834574854 2026-02-17T19:04:22.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-17T19:04:22.234 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:22.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-17T19:04:22.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:04:22.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:22.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:22.741 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:22.742 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:22.957 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:04:22.958 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:22.958 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:22.958 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:23.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:04:23.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:04:23.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:04:23.241 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-17T19:04:23.241 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-17T19:04:23.439 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:04:23.449 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-17T19:04:23.449 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-17T19:04:23.449 INFO:tasks.workunit.client.0.trial067.stdout:primary and soon to be divergent is 1 2026-02-17T19:04:23.450 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:04:23.656 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:04:23.657 INFO:tasks.workunit.client.0.trial067.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T19:04:15.724919+0000 0'0 28:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:32:19.286264+0000 0 0 2026-02-17T19:04:23.657 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:04:23.657 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:04:23.657 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:04:23.665 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-17T19:04:23.666 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771355063 2026-02-17T19:04:23.667 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771355063 - 1771355057 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=6 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-17T19:04:23.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T19:04:23.670 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-17T19:04:23.670 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-17T19:04:23.670 INFO:tasks.workunit.client.0.trial067.stdout:writing initial objects 2026-02-17T19:04:23.670 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-17T19:04:23.671 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-17T19:04:23.671 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.671 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.722 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.722 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.749 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.749 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.772 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.858 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.942 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.943 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.964 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.964 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:23.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:23.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.014 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.014 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.043 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.043 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.326 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.327 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.381 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.381 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.433 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.433 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.490 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.490 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.518 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.518 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.547 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.547 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.713 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.713 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.742 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.742 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.770 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.770 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.855 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.855 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.882 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.882 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.910 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.966 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.966 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:24.994 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:24.995 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.022 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.022 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.050 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.050 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.079 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.107 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.135 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.162 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.162 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.189 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.190 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.217 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.217 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.301 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.302 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.357 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.441 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.470 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.470 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.600 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.601 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.709 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.765 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.794 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.794 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.906 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.906 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.934 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.934 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:25.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:25.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.010 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.010 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.065 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.066 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.094 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.122 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.122 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.149 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.150 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.346 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.402 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T19:04:26.402 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.BKNFLz58nW 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:04:26.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:04:26.432 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:04:26.432 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:04:26.432 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:04:26.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:04:26.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:04:26.505 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:04:26.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:04:26.726 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:04:26.726 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:04:26.726 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:04:26.727 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:26.727 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:04:26.809 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T19:04:26.809 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T19:04:26.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T19:04:26.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:26.810 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:04:26.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T19:04:26.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T19:04:26.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T19:04:26.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:26.894 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:04:26.977 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-17T19:04:26.977 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-17T19:04:26.978 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-55834574857' 2026-02-17T19:04:26.978 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:26.978 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T19:04:26.978 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:26.979 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:04:26.980 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T19:04:26.980 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:26.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T19:04:26.981 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836492 2026-02-17T19:04:26.982 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T19:04:26.982 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:27.194 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T19:04:27.194 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:27.195 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T19:04:27.195 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:27.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:04:27.197 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T19:04:27.197 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:27.198 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T19:04:27.198 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 38654705674 2026-02-17T19:04:27.199 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T19:04:27.199 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:04:27.427 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T19:04:27.427 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:27.428 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-17T19:04:27.428 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:27.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:04:27.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-17T19:04:27.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:27.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-17T19:04:27.432 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 55834574857 2026-02-17T19:04:27.433 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-17T19:04:27.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:27.654 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574857 2026-02-17T19:04:27.654 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:04:28.655 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:04:28.656 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:28.872 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574857 2026-02-17T19:04:28.872 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:04:29.873 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T19:04:29.874 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:30.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574857 2026-02-17T19:04:30.097 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:04:30.098 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:30.098 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:30.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:04:30.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:30.384 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:30.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:04:30.603 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:30.603 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:30.603 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:30.892 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:04:30.892 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:04:30.893 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:04:30.893 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-17T19:04:30.893 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T19:04:30.893 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T19:04:30.894 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T19:04:30.894 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T19:04:31.117 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-17T19:04:31.117 INFO:tasks.workunit.client.0.trial067.stdout:blackholing osds 0 2 2026-02-17T19:04:31.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-17T19:04:31.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:04:31.321 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:04:31.321 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T19:04:15.724919+0000 28'100 28:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:32:19.286264+0000 0 0 2026-02-17T19:04:31.322 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:04:31.322 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:04:31.322 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:04:31.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:31.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-17T19:04:31.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:04:31.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:04:31.331 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:04:31.332 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:31.332 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:31.332 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:04:31.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:04:31.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T19:04:31.386 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:04:31.386 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:04:31.387 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:04:31.392 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:31.393 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:31.394 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:04:31.394 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:04:31.394 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T19:04:31.445 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:04:31.446 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:04:31.446 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:04:31.451 INFO:tasks.workunit.client.0.trial067.stdout:create new divergent objects 2026-02-17T19:04:31.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-17T19:04:31.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-17T19:04:31.453 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:04:31.453 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:04:31.453 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-17T19:04:31.453 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-17T19:04:31.453 INFO:tasks.workunit.client.0.trial067.stdout:writing divergent objects 2026-02-17T19:04:31.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-17T19:04:31.454 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-17T19:04:31.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T19:04:31.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T19:04:31.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.3HSB6N9oRd 2026-02-17T19:04:31.455 INFO:tasks.workunit.client.0.trial067.stdout:remove divergent objects 2026-02-17T19:04:31.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-17T19:04:31.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.3HSB6N9oRd 2026-02-17T19:04:31.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-17T19:04:31.457 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T19:04:31.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-17T19:04:31.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-17T19:04:31.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T19:04:31.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-17T19:04:31.459 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-17T19:04:31.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-17T19:04:31.460 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-17T19:04:31.460 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-17T19:04:41.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-17T19:04:41.513 INFO:tasks.workunit.client.0.trial067.stderr:rados: no process found 2026-02-17T19:04:41.513 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-17T19:04:41.514 INFO:tasks.workunit.client.0.trial067.stdout:killing all the osds 2026-02-17T19:04:41.514 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:04:41.733 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:04:41.734 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T19:04:15.724919+0000 28'106 28:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:32:19.286264+0000 0 0 2026-02-17T19:04:41.734 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:04:41.734 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:04:41.734 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:04:41.742 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-17T19:04:41.743 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:04:41.743 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:04:41.743 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:04:41.743 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:04:41.743 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:04:41.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:04:41.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T19:04:41.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-17T19:04:42.118 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already down. 2026-02-17T19:04:42.128 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T19:04:42.133 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-17T19:04:42.389 INFO:tasks.workunit.client.0.trial067.stderr:osd.1 is already down. 2026-02-17T19:04:42.399 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T19:04:42.399 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-17T19:04:42.676 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already down. 2026-02-17T19:04:42.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:42.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-17T19:04:42.963 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already out. 2026-02-17T19:04:42.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:42.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-17T19:04:43.238 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already out. 2026-02-17T19:04:43.249 INFO:tasks.workunit.client.0.trial067.stdout:bringing up non_divergent 0 2 2026-02-17T19:04:43.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-17T19:04:43.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:04:43.461 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:04:43.461 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T19:04:15.724919+0000 28'106 28:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T01:32:19.286264+0000 0 0 2026-02-17T19:04:43.461 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:04:43.461 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:04:43.462 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:04:43.473 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:43.473 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-17T19:04:43.473 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:04:43.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:04:43.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:04:43.476 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:04:43.477 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:04:43.477 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:04:43.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:04:43.500 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:43.490+0000 7f96511eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:43.502 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:43.490+0000 7f96511eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:43.503 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:43.490+0000 7f96511eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:43.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:04:43.694 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:43.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:43.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:04:43.866 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:43.854+0000 7f96511eba40 -1 Falling back to public interface 2026-02-17T19:04:43.915 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:44.480 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:44.470+0000 7f96511eba40 -1 osd.0 28 log_to_monitors true 2026-02-17T19:04:44.916 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:44.917 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:44.917 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:04:44.917 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:44.917 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:44.917 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:04:45.134 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/1581452546,v1:127.0.0.1:6801/1581452546] [v2:127.0.0.1:6802/1581452546,v1:127.0.0.1:6803/1581452546] exists,up 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:04:45.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:04:45.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:04:45.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:04:45.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:45.137 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:04:45.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:04:45.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:04:45.140 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:04:45.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:04:45.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:04:45.159 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:45.146+0000 7f60ad280a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:45.160 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:45.150+0000 7f60ad280a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:45.161 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:45.150+0000 7f60ad280a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:04:45.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:45.359 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:04:45.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:04:45.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:45.359 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:04:45.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:04:45.614 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:45.602+0000 7f60ad280a40 -1 Falling back to public interface 2026-02-17T19:04:46.258 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:04:46.246+0000 7f60ad280a40 -1 osd.2 28 log_to_monitors true 2026-02-17T19:04:46.579 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:04:46.580 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:04:46.580 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:04:46.580 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:04:46.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:04:46.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:04:46.799 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1828217343,v1:127.0.0.1:6811/1828217343] [v2:127.0.0.1:6812/1828217343,v1:127.0.0.1:6813/1828217343] exists,up 28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:04:46.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:04:46.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:04:46.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:04:46.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:46.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-17T19:04:47.045 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already in. 2026-02-17T19:04:47.055 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:04:47.056 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-17T19:04:47.318 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already in. 2026-02-17T19:04:47.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:04:47.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-17T19:04:47.328 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:04:47.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:04:47.329 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:04:47.329 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:04:47.330 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:04:47.330 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:04:47.330 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:04:47.330 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:04:47.330 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:04:47.388 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:04:47.608 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:04:47.609 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:04:47.609 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:04:47.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:04:47.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:47.609 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:04:47.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T19:04:47.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T19:04:47.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T19:04:47.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:47.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:04:47.760 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:04:47.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T19:04:47.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T19:04:47.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-17T19:04:47.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:47.842 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T19:04:47.842 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:47.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:04:47.844 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T19:04:47.844 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:47.845 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T19:04:47.845 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 150323855363 2026-02-17T19:04:47.846 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T19:04:47.846 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:48.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T19:04:48.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:04:49.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:04:49.069 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:04:49.293 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T19:04:49.293 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:04:49.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-17T19:04:49.294 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:04:49.295 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:04:49.295 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-17T19:04:49.295 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:04:49.297 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T19:04:49.297 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-17T19:04:49.297 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 163208757251 2026-02-17T19:04:49.298 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:04:49.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T19:04:49.520 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:04:49.520 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:49.520 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:49.811 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:49.812 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:49.812 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:50.023 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:50.024 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:50.024 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:50.024 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:50.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:50.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:04:50.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:04:50.309 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:04:50.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:50.310 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:04:50.410 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:04:50.410 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:50.411 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:50.411 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:50.411 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:50.411 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:50.412 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:50.412 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:50.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:50.628 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:50.628 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:50.628 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:50.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:50.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:04:50.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:04:50.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:04:51.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:04:51.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:04:51.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:04:51.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:51.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:04:51.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:04:51.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:51.409 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:51.409 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:51.409 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:51.410 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:51.410 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:51.410 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:51.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:51.619 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:51.619 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:51.619 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:51.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:51.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:04:51.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:04:51.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:04:51.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:04:51.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:04:51.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:04:51.912 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:04:51.912 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:04:52.208 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:04:52.208 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:04:52.208 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:04:52.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:52.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:04:52.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:04:52.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:52.610 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:52.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:52.826 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:52.826 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:52.826 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:04:53.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:04:53.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:04:53.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:04:53.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:04:53.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:53.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:54.191 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:54.192 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:54.192 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:54.403 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:54.403 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:54.404 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:54.404 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:54.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:54.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:04:54.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:04:54.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:04:54.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:04:54.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:04:54.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:04:54.694 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:04:54.694 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:04:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:04:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:04:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:04:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:04:56.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:04:56.581 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:04:56.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:04:56.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:04:56.582 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:04:56.583 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:04:56.583 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:04:56.583 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:04:56.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:04:56.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:04:56.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:04:56.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:04:57.085 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:04:57.086 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:04:57.378 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:04:57.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:04:57.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:04:57.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:04:57.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:05:00.580 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:00.580 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:00.581 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:00.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:00.799 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:00.800 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:00.800 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:01.087 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:05:01.087 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:01.087 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:01.088 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:01.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:01.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:05:01.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:01.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:05:07.774 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:07.774 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:07.775 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:07.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:07.985 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:07.985 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:07.985 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:08.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:05:08.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:08.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:08.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:08.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:08.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:08.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:08.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:08.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:08.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:08.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:08.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:05:08.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:08.571 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:05:15.871 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:15.872 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:15.873 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:16.091 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:16.091 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:16.092 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:16.092 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:16.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:16.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:16.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:16.374 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:16.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:16.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:16.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:16.375 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:16.375 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:16.663 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:16.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:16.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:05:16.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:05:16.939 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "99223761-4816-4dd4-b52b-d13fca67c412", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:05:16.929487+0000", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:05:16.940 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:16.941 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:05:16.942 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "count": 32 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.943 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.944 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.945 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.946 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.947 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.948 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.949 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.950 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:04:02.390057Z", 2026-02-17T19:05:16.951 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:04:02.390057Z", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:05:16.952 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:05:16.953 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:05:16.954 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:04:02:390055+0000", 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 44, 2026-02-17T19:05:16.955 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:04:02.476301+0000", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:05:07.078019+0000", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:04:46.403437+0000", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:04:47.254137+0000", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:05:16.956 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 9, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:05:16.957 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:04:15.594537+0000", 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 1, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool", 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:05:16.958 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 0, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "on", 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 32, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 32, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 32, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 32, 2026-02-17T19:05:16.959 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "43", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "43", 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:05:16.960 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "selfmanaged", 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 0, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 0, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [], 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:05:16.961 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "", 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:05:16.962 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {}, 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "read_balance": { 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "score_type": "Fair distribution", 2026-02-17T19:05:16.963 INFO:tasks.workunit.client.0.trial067.stdout: "score_acting": 2.9900000095367432, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "score_stable": 2.9900000095367432, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_acting": 2, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_stable": 2, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity_weighted": 1, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity": 1, 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity_weighted": 1 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.964 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "662f1b06-4ff5-40a4-880c-d75c6f2efcd8", 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 35, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 43, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 29, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.965 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:16.966 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.967 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.968 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.969 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/1581452546", 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/1581452546", 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1581452546", 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1581452546", 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:16.970 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "1b34b3d7-c7bf-493f-9741-d4eef44112e5", 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 9, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 20, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.971 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.972 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:16.973 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.974 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.975 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/746596475", 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/746596475", 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/746596475", 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/746596475", 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "28d024e8-0402-4692-b6cb-b82a48229f95", 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:16.976 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 13, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 38, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.977 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:05:16.978 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:05:16.979 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.980 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/1828217343", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/1828217343", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1828217343", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1828217343", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.051111+0000", 2026-02-17T19:05:16.981 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:04:06.168937+0000", 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.324872+0000", 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:16.982 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.609604+0000", 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:04:13.747656+0000", 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:05:16.983 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:05:16.984 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/1581452546,v1:127.0.0.1:6803/1581452546]", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:16.985 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:03.435614Z", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:16.986 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/1581452546,v1:127.0.0.1:6801/1581452546]", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1581452546,v1:127.0.0.1:6807/1581452546]", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1581452546,v1:127.0.0.1:6805/1581452546]", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:16.987 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/746596475,v1:127.0.0.1:6813/746596475]", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:16.988 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:16.989 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:07.091666Z", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/746596475,v1:127.0.0.1:6811/746596475]", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/746596475,v1:127.0.0.1:6817/746596475]", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/746596475,v1:127.0.0.1:6815/746596475]", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:16.990 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/1828217343,v1:127.0.0.1:6813/1828217343]", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:16.991 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:11.217485Z", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:16.992 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/1828217343,v1:127.0.0.1:6811/1828217343]", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1828217343,v1:127.0.0.1:6817/1828217343]", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1828217343,v1:127.0.0.1:6815/1828217343]", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:16.993 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 35 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 39 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 44, 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:05:16.994 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:16.995 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:05:16.996 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stderr:report 175386879 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:05:16.997 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.998 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:16.999 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:17.000 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.001 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:05:17.002 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 0, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:04:02:476064+0000", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:05:17.003 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.004 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 32, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 32, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:05:17.005 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:05:17.006 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 512, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 512, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "up": 64, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 64, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 65, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83928, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2144, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488872, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036604928, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2195456, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 451474, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28012, 2026-02-17T19:05:17.007 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661460 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 65, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:05:17.008 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83928, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2144, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488872, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036604928, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2195456, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 451474, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28012, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661460 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.009 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 32, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51200, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 100, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 100, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:05:17.010 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1220608, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 153552, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 512, 2026-02-17T19:05:17.011 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 512, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "up": 64, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 64, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 150323855369 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 38654705677 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 163208757256 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded+wait", 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "num": 31 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:05:17.012 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 32, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 32, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 32, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:05:17.013 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 3, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:05:10.926490+0000", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "0": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 37, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 228, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 317, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:05:17.014 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stdout:writing non-divergent object existing_4 2026-02-17T19:05:17.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:17.157 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:17.157 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089671+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090719+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089176+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089473+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088849+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088841+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088899+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092092+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092144+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091858+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089163+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089539+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089428+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089418+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089132+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088855+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-17T19:05:07.086641+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091757+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092098+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092135+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088773+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.158 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087070+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088804+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087087+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090727+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090824+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087011+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088675+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.086961+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088711+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:17.159 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:17.166 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.3HSB6N9oRd 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:05:17.197 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:05:17.198 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:05:17.198 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:05:17.199 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:05:17.199 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:05:17.199 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:05:17.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:05:17.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:05:17.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:05:17.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:05:17.271 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:05:17.271 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:05:17.487 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:05:17.487 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:05:17.488 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:05:17.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:05:17.488 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:05:17.488 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:05:17.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-17T19:05:17.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-17T19:05:17.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-17T19:05:17.570 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:05:17.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:05:17.635 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:05:17.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-17T19:05:17.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-17T19:05:17.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-163208757259' 2026-02-17T19:05:17.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:05:17.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-17T19:05:17.717 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:05:17.718 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:05:17.719 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-17T19:05:17.719 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:05:17.721 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-17T19:05:17.721 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-17T19:05:17.721 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 150323855371 2026-02-17T19:05:17.722 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:05:17.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-17T19:05:17.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:05:18.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:05:18.940 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:05:19.155 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-17T19:05:19.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:05:19.156 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757259 2026-02-17T19:05:19.157 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:05:19.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:05:19.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-17T19:05:19.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:05:19.159 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757259 2026-02-17T19:05:19.160 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 163208757259 2026-02-17T19:05:19.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-17T19:05:19.160 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:05:19.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-17T19:05:19.396 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:05:19.396 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:19.396 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:19.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:19.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:19.903 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:19.903 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:19.903 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:20.191 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:20.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:05:20.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:05:20.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:05:20.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:20.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:05:20.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:20.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:20.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:20.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:20.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:20.293 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:20.294 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:20.294 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:20.510 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:20.511 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:20.511 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:20.511 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:20.795 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:21.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:21.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:21.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:05:21.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:21.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:05:21.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:21.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:21.280 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:21.494 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:21.495 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:21.495 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:21.495 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:21.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:21.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:21.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:21.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:21.775 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:21.776 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:21.776 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:21.776 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:21.776 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:22.066 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:22.066 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:22.066 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:05:22.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:22.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:05:22.467 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:22.467 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:22.468 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:22.468 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:22.469 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:22.469 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:22.469 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:22.469 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:22.688 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:22.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:22.689 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:22.689 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:22.973 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:22.973 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:22.973 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:22.973 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:22.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:22.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:22.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:22.974 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:22.974 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:23.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:23.252 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:23.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:05:23.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:23.253 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:24.053 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:24.054 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:24.054 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:24.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:24.265 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:24.265 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:24.265 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:24.563 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:24.564 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:24.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:24.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:24.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:05:24.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:24.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:05:26.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:26.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:26.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:26.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:26.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:26.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:26.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:26.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:26.666 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:26.666 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:26.666 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:26.667 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:26.943 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:26.943 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:26.944 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:27.224 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:27.224 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:27.224 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:05:27.224 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:27.224 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:05:30.424 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:30.425 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:30.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:30.644 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:30.645 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:30.645 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:30.645 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:30.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:30.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:30.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:30.933 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:31.218 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:31.218 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:31.218 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:05:31.218 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:31.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:05:37.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:37.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:37.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:37.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:37.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:37.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:37.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:37.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:37.837 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:37.838 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:37.838 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:37.838 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:38.112 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:38.113 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:38.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:38.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:38.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:05:38.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:05:38.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:05:45.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:05:45.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:05:45.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:05:45.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:05:45.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:05:45.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:05:45.698 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:05:45.699 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:05:45.912 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:05:45.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:05:45.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:05:45.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:05:46.206 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:05:46.207 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:05:46.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:05:46.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:05:46.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:05:46.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:05:46.783 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:05:46.783 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "99223761-4816-4dd4-b52b-d13fca67c412", 2026-02-17T19:05:46.783 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:46.783 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:05:46.783 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:05:46.772677+0000", 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.784 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.785 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:05:46.786 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: "count": 32 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.787 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.788 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.789 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.790 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.791 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.792 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.793 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.794 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.795 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:05:46.796 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:04:02.390057Z", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:04:02.390057Z", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:05:46.797 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.798 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:05:46.799 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:04:02:390055+0000", 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.800 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 44, 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:04:02.476301+0000", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:05:07.078019+0000", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:04:46.403437+0000", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:04:47.254137+0000", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:05:46.801 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 9, 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:05:46.802 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:05:46.803 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:04:15.594537+0000", 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 1, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool", 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 0, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:05:46.804 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "on", 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 32, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 32, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 32, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 32, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:05:46.805 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "43", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "43", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "selfmanaged", 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 0, 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 0, 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [], 2026-02-17T19:05:46.806 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:05:46.807 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "", 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:05:46.808 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 0, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {}, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "read_balance": { 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "score_type": "Fair distribution", 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "score_acting": 2.9900000095367432, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "score_stable": 2.9900000095367432, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_acting": 2, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "raw_score_stable": 2, 2026-02-17T19:05:46.809 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity_weighted": 1, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity": 1, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "average_primary_affinity_weighted": 1 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "662f1b06-4ff5-40a4-880c-d75c6f2efcd8", 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:46.810 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 35, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 43, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 29, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:05:46.811 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.812 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.813 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.814 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1581452546 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.815 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/1581452546", 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/1581452546", 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1581452546", 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1581452546", 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:46.816 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "1b34b3d7-c7bf-493f-9741-d4eef44112e5", 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 9, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 20, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.817 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:46.818 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.819 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:46.820 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 746596475 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/746596475", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/746596475", 2026-02-17T19:05:46.821 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/746596475", 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/746596475", 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "28d024e8-0402-4692-b6cb-b82a48229f95", 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 13, 2026-02-17T19:05:46.822 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 38, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.823 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.824 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:05:46.825 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1828217343 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.826 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/1828217343", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/1828217343", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1828217343", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1828217343", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.051111+0000", 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:46.827 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:04:06.168937+0000", 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.324872+0000", 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:04:42.609604+0000", 2026-02-17T19:05:46.828 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:04:13.747656+0000", 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:05:46.829 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.830 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/1581452546,v1:127.0.0.1:6803/1581452546]", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:46.831 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:03.435614Z", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/1581452546,v1:127.0.0.1:6801/1581452546]", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1581452546,v1:127.0.0.1:6807/1581452546]", 2026-02-17T19:05:46.832 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1581452546,v1:127.0.0.1:6805/1581452546]", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/746596475,v1:127.0.0.1:6813/746596475]", 2026-02-17T19:05:46.833 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:46.834 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:07.091666Z", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/746596475,v1:127.0.0.1:6811/746596475]", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/746596475,v1:127.0.0.1:6817/746596475]", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/746596475,v1:127.0.0.1:6815/746596475]", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:46.835 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/1828217343,v1:127.0.0.1:6813/1828217343]", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:05:46.836 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:04:11.217485Z", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:05:46.837 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/1828217343,v1:127.0.0.1:6811/1828217343]", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1828217343,v1:127.0.0.1:6817/1828217343]", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1828217343,v1:127.0.0.1:6815/1828217343]", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:05:46.838 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 35 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 39 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 44, 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:05:46.839 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.840 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.841 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stderr:report 3471579695 2026-02-17T19:05:46.842 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.843 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.844 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:05:46.845 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.846 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:05:46.847 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 0, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:04:02:476064+0000", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:05:46.848 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 32, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 32, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51688, 2026-02-17T19:05:46.849 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:05:46.850 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 513, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 513, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "up": 64, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 64, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 65, 2026-02-17T19:05:46.851 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83928, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2144, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488872, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036604928, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2195456, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 452450, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28012, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661460 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:05:46.852 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 65, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83928, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2144, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488872, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036604928, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2195456, 2026-02-17T19:05:46.853 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 452450, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 28012, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661460 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 32, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 51688, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 100, 2026-02-17T19:05:46.854 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 300, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 100, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 100, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:05:46.855 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1220608, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 154528, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 513, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 513, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "up": 64, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 64, 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:05:46.856 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 150323855377 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 38654705677 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 163208757264 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num": 32 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 32, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:05:46.857 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 32, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 32, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 4, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:05:44.931672+0000", 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:05:46.858 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 52, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 292, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 396, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery 2026-02-17T19:05:46.859 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089671+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090719+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089176+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089473+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088849+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088841+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088899+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092092+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092144+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091858+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089163+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.014 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089539+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089428+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089418+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089132+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088855+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:19.359541+0000 28'100 44:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:07.280773+0000 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091757+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:05:07.092098+0000 44'101 44:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092135+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088773+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087070+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088804+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087087+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090727+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090824+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087011+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088675+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.086961+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088711+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:47.015 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:47.016 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:47.024 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:05:47.025 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-17T19:05:47.025 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:05:47.025 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:05:47.026 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T19:05:47.092 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:05:47.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:05:47.099 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:05:47.100 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:05:47.100 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T19:05:47.157 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:05:47.163 INFO:tasks.workunit.client.0.trial067.stdout:revive divergent 1 2026-02-17T19:05:47.164 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-17T19:05:47.164 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089671+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090719+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089176+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089473+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088849+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.365 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088841+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088899+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092092+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092144+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091858+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089163+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089539+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089428+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089418+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089132+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088855+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.366 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:19.359541+0000 28'100 44:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:07.280773+0000 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091757+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:05:07.092098+0000 44'101 44:147 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092135+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088773+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087070+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088804+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087087+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089137+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090727+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090824+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087011+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.367 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088675+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.368 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.086961+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.368 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088711+0000 28'100 44:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:47.368 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:47.368 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:47.368 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:47.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-17T19:05:47.700 INFO:tasks.workunit.client.0.trial067.stderr:noup is set 2026-02-17T19:05:47.714 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:05:47.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:05:47.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:05:47.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:05:47.718 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:05:47.718 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:05:47.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:05:47.719 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:05:47.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:05:47.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:05:47.719 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:05:47.720 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:05:47.739 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:47.726+0000 7ffbf4925a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:47.741 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:47.730+0000 7ffbf4925a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:47.742 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:47.730+0000 7ffbf4925a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:47.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T19:05:47.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-17T19:05:48.058 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:48.046+0000 7ffbf4925a40 -1 Falling back to public interface 2026-02-17T19:05:48.693 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:48.682+0000 7ffbf4925a40 -1 osd.1 28 log_to_monitors true 2026-02-17T19:05:52.940 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery divergent 2026-02-17T19:05:52.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-17T19:05:52.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:53.143 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:53.143 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089671+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.143 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090719+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089176+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:48.383852+0000 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089473+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088849+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:39.457002+0000 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088841+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:32.548947+0000 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088899+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:36.403735+0000 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092092+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092144+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.144 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091858+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089163+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089539+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089428+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089418+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089132+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088855+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:19.359541+0000 28'100 47:153 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:07.280773+0000 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.091757+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T19:05:07.092098+0000 44'101 47:153 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.145 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.092135+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088773+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:33.522908+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087070+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:14.418009+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087137+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:22.513023+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088804+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:34.493213+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087087+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:16.507684+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.089137+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:47.340751+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090727+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.090824+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.087011+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:15.467703+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088675+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:37.394207+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.086961+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:12.415342+0000 0 0 2026-02-17T19:05:53.146 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:05:07.088711+0000 28'100 47:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 user requested scrub scheduled @ 2026-02-17T19:06:25.532938+0000 0 0 2026-02-17T19:05:53.147 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:53.147 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:53.147 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:53.152 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-17T19:05:53.153 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:05:53.153 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:05:53.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:05:53.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:05:53.153 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:05:53.154 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:05:53.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:05:53.154 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T19:05:53.209 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:05:53.214 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-17T19:05:53.520 INFO:tasks.workunit.client.0.trial067.stderr:noup is unset 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:05:53.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:05:53.744 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 35 up_thru 43 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/1581452546,v1:127.0.0.1:6801/1581452546] [v2:127.0.0.1:6802/1581452546,v1:127.0.0.1:6803/1581452546] exists,up 662f1b06-4ff5-40a4-880c-d75c6f2efcd8 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:05:53.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:05:53.747 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:05:53.747 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:05:53.747 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:05:53.748 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:05:53.960 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1055123750,v1:127.0.0.1:6819/1055123750] [v2:127.0.0.1:6820/1055123750,v1:127.0.0.1:6821/1055123750] exists,up 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:05:53.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:05:53.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:05:53.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:05:53.963 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:05:53.963 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:05:53.964 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:05:54.177 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1828217343,v1:127.0.0.1:6811/1828217343] [v2:127.0.0.1:6812/1828217343,v1:127.0.0.1:6813/1828217343] exists,up 28d024e8-0402-4692-b6cb-b82a48229f95 2026-02-17T19:05:54.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:05:54.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:05:54.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:05:54.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513312+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513328+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.519966+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513277+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.378 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513282+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.512765+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520216+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520218+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520131+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520244+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520241+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520227+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520239+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513459+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512650+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512958+0000 28'106 49:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.379 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520127+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520001+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520211+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.511974+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512142+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512294+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512568+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512845+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512914+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513375+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513377+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.511943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.380 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512280+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.381 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512457+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.381 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512389+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.381 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:54.381 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:54.381 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:54.386 INFO:tasks.workunit.client.0.trial067.stdout:wait for peering 2026-02-17T19:05:54.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-17T19:05:54.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:54.605 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:54.605 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513312+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.605 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513328+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.519966+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513277+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513282+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.512765+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520216+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520218+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520131+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520244+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520241+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.606 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520227+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520239+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513459+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512650+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512958+0000 28'106 49:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520127+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520001+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520211+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.511974+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512142+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.607 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512294+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512568+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512845+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512914+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513375+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513377+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.511943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512280+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512457+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.608 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512389+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.609 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:54.609 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:54.609 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:54.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.BKNFLz58nW 2026-02-17T19:05:54.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.BKNFLz58nW 2026-02-17T19:05:54.652 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.3HSB6N9oRd 2026-02-17T19:05:54.653 INFO:tasks.workunit.client.0.trial067.stdout:killing divergent 1 2026-02-17T19:05:54.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-17T19:05:54.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:54.861 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513312+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513328+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.519966+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513277+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513282+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.512765+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520216+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520218+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.862 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520131+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520244+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520241+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520227+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520239+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513459+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512650+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512958+0000 28'106 49:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520127+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520001+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520211+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.511974+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.863 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512142+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512294+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512568+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512845+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512914+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513375+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513377+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.511943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512280+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512457+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512389+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:54.864 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:54.865 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:54.870 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T19:05:54.871 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:05:54.871 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:05:54.871 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:05:54.871 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:05:54.871 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:05:54.979 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:05:54.979 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.16378.out 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16378.out 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T19:05:54.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16378.out 2026-02-17T19:05:55.181 INFO:tasks.workunit.client.0.trial067.stderr:Exporting 1.0 info 1.0( v 28'100 (28'90,28'100] local-lis/les=49/51 n=3 ec=20/20 lis/c=49/49 les/c/f=51/51/0 sis=49) 2026-02-17T19:05:55.182 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T19:05:55.182 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T19:05:55.183 INFO:tasks.workunit.client.0.trial067.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T19:05:55.183 INFO:tasks.workunit.client.0.trial067.stderr:Export successful 2026-02-17T19:05:55.183 INFO:tasks.workunit.client.0.trial067.stdout: marking collection for removal 2026-02-17T19:05:55.183 INFO:tasks.workunit.client.0.trial067.stdout:setting '_remove' omap key 2026-02-17T19:05:55.183 INFO:tasks.workunit.client.0.trial067.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T19:05:55.184 INFO:tasks.workunit.client.0.trial067.stderr:Remove successful 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16378.out 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T19:05:55.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16378.out 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:get_pg_num_history pg_num_history pg_num_history(e51 pg_nums {1={20=1,43=32}} deleted_pools ) 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:Importing pgid 1.0 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T19:05:55.477 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:05:55.478 INFO:tasks.workunit.client.0.trial067.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T19:05:55.478 INFO:tasks.workunit.client.0.trial067.stdout:snapset 0={} 2026-02-17T19:05:55.478 INFO:tasks.workunit.client.0.trial067.stdout:write_pg epoch 51 info 1.0( v 28'100 (28'90,28'100] local-lis/les=49/51 n=3 ec=20/20 lis/c=49/49 les/c/f=51/51/0 sis=49) 2026-02-17T19:05:55.478 INFO:tasks.workunit.client.0.trial067.stdout:Import successful 2026-02-17T19:05:55.588 INFO:tasks.workunit.client.0.trial067.stdout:reviving divergent 1 2026-02-17T19:05:55.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-17T19:05:55.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:05:55.793 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:05:55.793 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513312+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513328+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.519966+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513277+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513282+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.512765+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520216+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520218+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520131+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520244+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520241+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520227+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520239+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.513459+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512650+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512958+0000 28'106 49:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520127+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520001+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.520211+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T19:05:53.511974+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.794 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512142+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512294+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512568+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512845+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512914+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513375+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.513377+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.511943+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512280+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512457+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T19:05:53.512389+0000 28'106 50:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:05:55.795 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:05:55.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:05:55.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:05:55.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:05:55.806 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:05:55.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:05:55.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:05:55.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:05:55.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:05:55.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:05:55.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:05:55.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:05:55.832 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:55.822+0000 7f0a09258a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:55.834 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:55.822+0000 7f0a09258a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:55.835 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:55.822+0000 7f0a09258a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:05:56.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T19:05:56.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:05:56.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:05:56.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:05:56.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:05:56.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:05:56.020 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:05:56.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:05:56.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:05:56.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:05:56.221 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:56.210+0000 7f0a09258a40 -1 Falling back to public interface 2026-02-17T19:05:56.233 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1055123750,v1:127.0.0.1:6819/1055123750] [v2:127.0.0.1:6820/1055123750,v1:127.0.0.1:6821/1055123750] exists,up 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:05:56.234 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:05:56.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:05:56.235 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:05:56.235 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:05:56.236 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:05:56.236 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:05:56.455 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1055123750,v1:127.0.0.1:6819/1055123750] [v2:127.0.0.1:6820/1055123750,v1:127.0.0.1:6821/1055123750] exists,up 1b34b3d7-c7bf-493f-9741-d4eef44112e5 2026-02-17T19:05:56.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:05:56.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:05:56.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:05:56.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-17T19:05:56.924 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:05:56.910+0000 7f0a09258a40 -1 osd.1 51 log_to_monitors true 2026-02-17T19:06:16.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-17T19:06:16.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:06:16.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-17T19:06:16.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T19:06:16.522 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:06:16.522 INFO:tasks.workunit.client.0.trial067.stdout: "ops": [], 2026-02-17T19:06:16.522 INFO:tasks.workunit.client.0.trial067.stdout: "num_ops": 0 2026-02-17T19:06:16.522 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:06:16.527 INFO:tasks.workunit.client.0.trial067.stdout:allowing recovery 2026-02-17T19:06:16.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-17T19:06:16.528 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.093039+0000 28'100 61:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:05.093704+0000 28'100 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094318+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092557+0000 28'100 61:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.747 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:05.092845+0000 28'100 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094966+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:06.803708+0000 28'100 61:182 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:06.803645+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T21:00:03.683684+0000 3 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092577+0000 28'100 61:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.6 5 0 0 0 0 2560 0 0 17 84 17 active+clean 2026-02-17T19:06:14.436217+0000 51'101 62:175 [0,1,2] 0 [0,1,2] 0 51'101 2026-02-17T19:06:14.436171+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-19T05:06:13.166316+0000 5 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094702+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:05:57.295264+0000 28'100 61:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092762+0000 28'100 61:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T19:06:13.395944+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:13.395903+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:17:31.916858+0000 1 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-17T19:05:57.297760+0000 28'100 61:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094397+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.748 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:05:57.298097+0000 28'100 61:173 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:08.743670+0000 28'100 61:181 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:08.743628+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-19T06:44:33.197365+0000 3 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094655+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-17T19:06:05.092852+0000 44'101 62:175 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092795+0000 28'100 61:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:11.800271+0000 28'100 61:182 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:11.800228+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:34:05.937672+0000 3 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T19:06:06.070044+0000 28'100 61:155 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:06.070001+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:28:21.666347+0000 3 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T19:06:12.430530+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:12.430488+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T00:47:53.714872+0000 1 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092999+0000 28'100 61:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:05:57.296318+0000 28'100 61:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094263+0000 28'100 61:147 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:05.093105+0000 28'100 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.749 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092997+0000 28'100 61:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:05:57.295530+0000 28'100 61:174 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T19:06:10.959849+0000 28'100 61:155 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:10.959797+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T20:56:15.585775+0000 2 0 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T19:06:10.407060+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:10.407020+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:25:49.082594+0000 4 0 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092997+0000 28'100 61:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:06:16.750 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:06:16.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T19:06:16.755 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T19:06:16.846 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:06:16.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T19:06:16.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T19:06:16.925 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:06:16.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T19:06:16.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T19:06:17.017 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:06:17.025 INFO:tasks.workunit.client.0.trial067.stdout:reading divergent objects 2026-02-17T19:06:17.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-17T19:06:17.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.093039+0000 28'100 64:178 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 peering 2026-02-17T19:06:16.992142+0000 28'100 64:166 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094318+0000 28'100 63:153 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:13.727488+0000 28'100 64:188 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T19:06:13.727448+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T22:27:19.963977+0000 3 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:05.092845+0000 28'100 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-17T19:06:12.959660+0000 28'100 63:161 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:12.959610+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-19T01:26:46.695958+0000 5 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:06.803708+0000 28'100 64:191 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:06.803645+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T19:31:21.127940+0000 3 0 2026-02-17T19:06:17.234 INFO:tasks.workunit.client.0.trial067.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092577+0000 28'100 64:178 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.6 5 0 0 0 0 2560 0 0 17 84 17 active+clean 2026-02-17T19:06:14.436217+0000 51'101 62:175 [0,1,2] 0 [0,1,2] 0 51'101 2026-02-17T19:06:14.436171+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-19T05:06:13.166316+0000 5 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094702+0000 28'100 63:153 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:05:57.295264+0000 28'100 64:182 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092762+0000 28'100 64:180 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T19:06:13.395944+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:13.395903+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:17:31.916858+0000 1 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-17T19:05:57.297760+0000 28'100 64:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T19:06:14.963385+0000 28'100 63:161 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:14.963331+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T23:40:04.087342+0000 2 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:05:57.298097+0000 28'100 64:182 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:08.743670+0000 28'100 64:190 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:08.743628+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-18T19:39:13.871948+0000 3 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094655+0000 28'100 63:153 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 peering 2026-02-17T19:06:16.991229+0000 44'101 64:167 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092795+0000 28'100 64:178 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:11.800271+0000 28'100 64:191 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T19:06:11.800228+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:16:10.778559+0000 3 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T19:06:06.070044+0000 28'100 63:161 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:06.070001+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:38:39.006611+0000 3 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T19:06:12.430530+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:12.430488+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T00:47:53.714872+0000 1 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T19:06:14.717351+0000 28'100 64:188 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T19:06:14.717307+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:05:50.423205+0000 3 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:05:57.296318+0000 28'100 64:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:03.094263+0000 28'100 63:153 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:05.093105+0000 28'100 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T19:06:07.092997+0000 28'100 64:178 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:05:57.295530+0000 28'100 64:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.235 INFO:tasks.workunit.client.0.trial067.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T19:06:10.959849+0000 28'100 63:161 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T19:06:10.959797+0000 0'0 2026-02-17T19:04:15.611982+0000 0 1 periodic scrub scheduled @ 2026-02-19T05:36:07.450359+0000 2 0 2026-02-17T19:06:17.236 INFO:tasks.workunit.client.0.trial067.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T19:06:10.407060+0000 28'100 62:182 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T19:06:10.407020+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:25:49.082594+0000 4 0 2026-02-17T19:06:17.236 INFO:tasks.workunit.client.0.trial067.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T19:06:07.092997+0000 28'100 64:181 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T19:04:15.611982+0000 0'0 2026-02-17T19:04:15.611982+0000 0 0 queued for scrub 0 0 2026-02-17T19:06:17.236 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:06:17.236 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:06:17.236 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:06:17.245 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-17T19:06:17.246 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-17T19:06:17.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:06:17.247 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T19:06:17.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:06:17.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T19:06:17.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:06:17.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T19:06:17.326 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:06:17.326 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T19:06:17.355 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-17T19:06:17.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:06:17.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T19:06:17.375 INFO:tasks.workunit.client.0.trial067.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T19:06:17.377 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T19:06:17.377 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T19:06:17.402 INFO:tasks.workunit.client.0.trial067.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T19:06:17.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-17T19:06:17.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T19:06:17.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4546.0:1 2026-02-17T19:04:31.464143+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 20 _merge_object_divergent_entries: keeping 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4546.0:1 2026-02-17T19:04:31.464143+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T19:06:17.412 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4546.0:1 2026-02-17T19:04:31.464143+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd20a2640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'89 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4553.0:1 2026-02-17T19:04:31.469646+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4553.0:1 2026-02-17T19:04:31.469646+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: more recent entry found: 44'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4662.0:1 2026-02-17T19:05:17.184390+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T19:06:17.413 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4542.0:1 2026-02-17T19:04:31.462970+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4542.0:1 2026-02-17T19:04:31.462970+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbcf89d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4547.0:1 2026-02-17T19:04:31.464889+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 20 _merge_object_divergent_entries: keeping 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4547.0:1 2026-02-17T19:04:31.464889+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T19:06:17.414 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4547.0:1 2026-02-17T19:04:31.464889+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4545.0:1 2026-02-17T19:04:31.463545+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:06:17.415 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4545.0:1 2026-02-17T19:04:31.463545+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:06:17.420 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:06:17.420 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-17T19:06:17.420 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T19:06:17.420 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.626+0000 7ffbd50a8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T19:06:17.420 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4552.0:1 2026-02-17T19:04:31.468771+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4552.0:1 2026-02-17T19:04:31.468771+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4552.0:1 2026-02-17T19:04:31.468771+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T19:06:17.421 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:05:54.630+0000 7ffbd60aa640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'84 2026-02-17T19:06:17.422 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T19:06:17.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:06:17.426 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T19:06:17.427 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:06:17.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-17T19:06:17.430 INFO:tasks.workunit.client.0.trial067.stdout:success 2026-02-17T19:06:17.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.16378.out 2026-02-17T19:06:17.431 INFO:tasks.workunit.client.0.trial067.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16378.out': No such file or directory 2026-02-17T19:06:17.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-17T19:06:17.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T19:06:17.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T19:06:17.697 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' does not exist 2026-02-17T19:06:17.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-17T19:06:17.708 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:06:17.708 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:06:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:06:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:06:17.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:06:23.023 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:06:23.024 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T19:06:23.024 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:06:23.024 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:06:23.024 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:06:23.025 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:06:23.025 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:06:23.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:06:23.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:06:23.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:06:23.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:06:23.032 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:06:23.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:06:23.034 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:06:23.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:06:23.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:06:23.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:06:23.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:06:23.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:06:23.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:06:23.037 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:06:23.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:06:23.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:06:23.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:06:23.067 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:06:23.067 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.067 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:06:23.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:06:23.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:06:23.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:06:23.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:06:23.072 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:06:23.073 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:06:23.073 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:06:23.074 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:06:23.074 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:06:23.074 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:06:23.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:06:23.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:06:23.076 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:06:23.077 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:06:23.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:06:23.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:06:23.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:06:23.080 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:06:23.080 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.081 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.081 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:06:23.082 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:06:23.082 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:06:23.082 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T19:06:23.083 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:06:23.083 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.083 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.083 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16378 2026-02-17T19:06:23.084 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-17T19:06:23.086 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-17T19:06:23.087 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T19:06:23.087 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:06:23.087 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.ayotjyc1YF 2026-02-17T19:06:23.087 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.ayotjyc1YF bs=512 count=1 2026-02-17T19:06:23.088 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:06:23.088 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:06:23.088 INFO:tasks.workunit.client.0.trial067.stderr:512 bytes copied, 0.000187951 s, 2.7 MB/s 2026-02-17T19:06:23.088 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:23.089 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.ayotjyc1YF 2026-02-17T19:06:23.089 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-17T19:06:23.089 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T19:06:23.089 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T19:06:23.090 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.8ofAA0cjKS 2026-02-17T19:06:23.090 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.8ofAA0cjKS bs=1000 count=1 2026-02-17T19:06:23.091 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records in 2026-02-17T19:06:23.091 INFO:tasks.workunit.client.0.trial067.stderr:1+0 records out 2026-02-17T19:06:23.091 INFO:tasks.workunit.client.0.trial067.stderr:1000 bytes (1.0 kB) copied, 0.000103543 s, 9.7 MB/s 2026-02-17T19:06:23.091 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.8ofAA0cjKS 2026-02-17T19:06:23.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.8ofAA0cjKS 2026-02-17T19:06:23.092 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-17T19:06:23.092 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-17T19:06:23.094 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-17T19:06:23.095 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-17T19:06:23.095 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:06:23.095 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:06:23.095 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-17T19:06:23.095 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T19:06:23.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:06:23.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:06:23.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:06:23.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T19:06:23.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T19:06:23.125 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:06:23.125 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:06:23.125 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:06:23.125 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:06:23.125 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.126 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.126 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:23.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:06:23.159 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:06:23.161 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:06:23.162 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:06:23.162 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:06:23.163 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:06:23.163 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.163 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.164 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:06:23.164 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:06:23.164 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get fsid 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:06:23.218 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:06:23.220 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:06:23.220 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.220 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.220 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-mon.a.asok 2026-02-17T19:06:23.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:06:23.221 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16378/ceph-mon.a.asok config get mon_host 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:06:23.273 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T19:06:23.274 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:06:23.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:06:23.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:06:23.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:06:23.389 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:06:23.389 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.390 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.390 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:23.390 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:06:23.391 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:06:23.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:23.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-17T19:06:23.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:06:23.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:06:23.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:06:23.415 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:06:23.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:06:23.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:06:23.418 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:06:23.418 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:06:23.418 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:06:23.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 561792a7-31f4-4230-b33b-f7e7da1f979c' 2026-02-17T19:06:23.419 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:06:23.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAvvJRpO+31GBAAf/5y9QwE8E5K4H7cmR3IiA== 2026-02-17T19:06:23.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAvvJRpO+31GBAAf/5y9QwE8E5K4H7cmR3IiA=="}' 2026-02-17T19:06:23.429 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 561792a7-31f4-4230-b33b-f7e7da1f979c -i td/divergent-priors/0/new.json 2026-02-17T19:06:23.544 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:06:23.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T19:06:23.552 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAvvJRpO+31GBAAf/5y9QwE8E5K4H7cmR3IiA== --osd-uuid 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:06:23.572 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:23.562+0000 7fbd674b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:23.574 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:23.562+0000 7fbd674b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:23.575 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:23.562+0000 7fbd674b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:23.575 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:23.562+0000 7fbd674b1a40 -1 bdev(0x55b474554400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:06:23.575 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:23.562+0000 7fbd674b1a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T19:06:24.304 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T19:06:24.304 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:06:24.305 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:06:24.305 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:06:24.306 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:06:24.430 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:06:24.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:06:24.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:06:24.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:06:24.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:06:24.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:06:24.462 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:24.450+0000 7f399a0e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:24.464 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:24.454+0000 7f399a0e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:24.465 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:24.454+0000 7f399a0e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:24.542 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:06:24.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:06:24.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:06:24.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:06:24.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:06:24.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:24.544 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:06:24.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:06:24.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:24.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:06:24.650 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:06:24.842 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:24.830+0000 7f399a0e8a40 -1 Falling back to public interface 2026-02-17T19:06:25.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:06:25.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:25.652 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:06:25.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:06:25.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:25.653 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:06:25.762 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:06:25.886 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:25.874+0000 7f399a0e8a40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:06:26.764 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:06:26.764 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:26.765 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:06:26.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:06:26.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:26.766 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:06:26.981 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/551283958,v1:127.0.0.1:6801/551283958] [v2:127.0.0.1:6802/551283958,v1:127.0.0.1:6803/551283958] exists,up 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:06:26.985 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:06:26.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f7a394e4-d8a0-468e-b55e-1236bf3b4d00' 2026-02-17T19:06:26.987 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:06:27.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAyvJRpV3EPOxAAC87OzblSkluvjbOF2V17Mw== 2026-02-17T19:06:27.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAyvJRpV3EPOxAAC87OzblSkluvjbOF2V17Mw=="}' 2026-02-17T19:06:27.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f7a394e4-d8a0-468e-b55e-1236bf3b4d00 -i td/divergent-priors/1/new.json 2026-02-17T19:06:27.223 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:06:27.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T19:06:27.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAyvJRpV3EPOxAAC87OzblSkluvjbOF2V17Mw== --osd-uuid f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:06:27.253 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:27.242+0000 7f4b3717da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:27.255 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:27.242+0000 7f4b3717da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:27.256 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:27.246+0000 7f4b3717da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:27.257 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:27.246+0000 7f4b3717da40 -1 bdev(0x55e15bcf6400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T19:06:27.257 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:27.246+0000 7f4b3717da40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T19:06:27.875 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T19:06:27.875 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:06:27.876 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:06:27.876 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:06:27.876 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:06:28.182 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:06:28.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:06:28.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:06:28.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:06:28.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:06:28.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:06:28.212 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:28.198+0000 7fef7a3f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:28.214 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:28.202+0000 7fef7a3f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:28.214 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:28.202+0000 7fef7a3f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:28.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:06:28.396 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:06:28.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:28.396 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:06:28.597 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:28.586+0000 7fef7a3f7a40 -1 Falling back to public interface 2026-02-17T19:06:28.612 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:06:29.174 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:29.162+0000 7fef7a3f7a40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:06:29.614 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:06:29.614 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:29.614 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:06:29.615 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:06:29.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:29.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:06:29.839 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2613418791,v1:127.0.0.1:6811/2613418791] [v2:127.0.0.1:6812/2613418791,v1:127.0.0.1:6813/2613418791] exists,up f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:06:29.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:06:29.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:06:29.841 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:06:29.842 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:06:29.843 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:06:29.844 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:06:29.844 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 4dbf484c-66f7-4174-8ed1-5edd567d6ace' 2026-02-17T19:06:29.844 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:06:29.844 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:06:29.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA1vJRpge6kMhAANbsoqzytQEYkixFhV1XtWA== 2026-02-17T19:06:29.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA1vJRpge6kMhAANbsoqzytQEYkixFhV1XtWA=="}' 2026-02-17T19:06:29.860 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4dbf484c-66f7-4174-8ed1-5edd567d6ace -i td/divergent-priors/2/new.json 2026-02-17T19:06:30.088 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:06:30.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T19:06:30.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA1vJRpge6kMhAANbsoqzytQEYkixFhV1XtWA== --osd-uuid 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:06:30.118 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:30.106+0000 7fbd64f17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:30.119 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:30.106+0000 7fbd64f17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:30.120 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:30.110+0000 7fbd64f17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:30.121 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:30.110+0000 7fbd64f17a40 -1 bdev(0x562c742b2400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:06:30.121 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:30.110+0000 7fbd64f17a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T19:06:30.714 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T19:06:30.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:06:30.715 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:06:30.715 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:06:30.716 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:06:31.020 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:06:31.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:06:31.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:06:31.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:06:31.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:06:31.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:06:31.051 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:31.038+0000 7f36cfcd0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:31.053 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:31.042+0000 7f36cfcd0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:31.054 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:31.042+0000 7f36cfcd0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:06:31.238 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:31.239 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:06:31.239 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:06:31.239 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:31.240 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:06:31.458 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:31.446+0000 7f36cfcd0a40 -1 Falling back to public interface 2026-02-17T19:06:31.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:06:32.054 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:06:32.042+0000 7f36cfcd0a40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:06:32.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:06:32.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:32.464 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:06:32.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:06:32.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:32.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:06:32.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:06:33.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:06:33.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:06:33.687 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:06:33.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:06:33.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:06:33.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:06:33.904 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1392305469,v1:127.0.0.1:6819/1392305469] [v2:127.0.0.1:6820/1392305469,v1:127.0.0.1:6821/1392305469] exists,up 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:06:33.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:06:33.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:06:33.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:06:33.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-17T19:06:34.194 INFO:tasks.workunit.client.0.trial067.stderr:noout is set 2026-02-17T19:06:34.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-17T19:06:34.498 INFO:tasks.workunit.client.0.trial067.stderr:noin is set 2026-02-17T19:06:34.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-17T19:06:34.802 INFO:tasks.workunit.client.0.trial067.stderr:nodown is set 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T19:06:34.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T19:06:35.073 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-17T19:06:35.073 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-17T19:06:35.452 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' already exists 2026-02-17T19:06:35.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T19:06:36.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T19:06:36.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-17T19:06:36.773 INFO:tasks.workunit.client.0.trial067.stderr:set pool 1 allow_ec_overwrites to true 2026-02-17T19:06:36.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T19:06:36.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:06:36.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:06:36.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:06:36.786 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:06:36.787 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:06:36.787 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:06:36.787 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:06:36.787 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:06:36.787 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:06:36.886 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:06:37.108 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:06:37.108 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:06:37.108 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:06:37.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:06:37.109 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:37.109 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:06:37.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T19:06:37.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T19:06:37.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T19:06:37.192 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:37.192 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:06:37.277 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T19:06:37.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T19:06:37.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T19:06:37.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:37.278 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:06:37.360 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T19:06:37.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T19:06:37.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542147' 2026-02-17T19:06:37.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:37.361 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T19:06:37.361 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:37.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:06:37.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T19:06:37.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:37.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T19:06:37.365 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T19:06:37.365 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836485 2026-02-17T19:06:37.365 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:37.583 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T19:06:37.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:06:38.585 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:06:38.585 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:38.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T19:06:38.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:38.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T19:06:38.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:38.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:06:38.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T19:06:38.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:38.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T19:06:38.810 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672964 2026-02-17T19:06:38.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T19:06:38.810 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:06:39.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T19:06:39.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:39.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T19:06:39.029 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:39.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:06:39.030 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T19:06:39.031 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:39.032 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T19:06:39.032 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542147 2026-02-17T19:06:39.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T19:06:39.033 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:06:39.251 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T19:06:39.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:06:39.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:39.252 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:06:39.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:06:39.538 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:06:39.538 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:06:39.756 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:06:39.756 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:06:39.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:39.757 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:40.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:06:40.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:06:40.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:06:40.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T19:06:40.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-17T19:06:40.043 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:06:40.043 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:06:40.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:06:40.260 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:06:40.260 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:06:40.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:06:40.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:40.260 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:06:40.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T19:06:40.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T19:06:40.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T19:06:40.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:40.341 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:06:40.421 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-17T19:06:40.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-17T19:06:40.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-17T19:06:40.422 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:40.422 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:06:40.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T19:06:40.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T19:06:40.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-60129542150' 2026-02-17T19:06:40.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:40.506 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T19:06:40.506 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:40.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:06:40.508 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T19:06:40.508 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:40.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T19:06:40.509 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836487 2026-02-17T19:06:40.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T19:06:40.509 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:40.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T19:06:40.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:06:41.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:06:41.731 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:41.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T19:06:41.949 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:41.950 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-17T19:06:41.950 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:41.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:06:41.953 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-17T19:06:41.953 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:41.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-17T19:06:41.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-17T19:06:41.955 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672967 2026-02-17T19:06:41.955 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:06:42.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-17T19:06:42.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:42.177 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T19:06:42.177 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:42.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:06:42.179 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T19:06:42.179 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:42.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T19:06:42.181 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542150 2026-02-17T19:06:42.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T19:06:42.181 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:06:42.404 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:06:42.405 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:06:42.405 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:06:42.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:06:42.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:06:42.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:06:42.509 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:06:42.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:06:42.728 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:06:42.728 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:06:42.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:06:42.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:42.729 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:06:42.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T19:06:42.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T19:06:42.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T19:06:42.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:42.813 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:06:42.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672969 2026-02-17T19:06:42.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672969 2026-02-17T19:06:42.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-17T19:06:42.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:42.898 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:06:42.980 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-17T19:06:42.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-17T19:06:42.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-60129542152' 2026-02-17T19:06:42.981 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:42.981 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T19:06:42.981 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:42.982 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:06:42.982 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T19:06:42.982 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:42.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T19:06:42.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T19:06:42.984 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836490 2026-02-17T19:06:42.985 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:43.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-17T19:06:43.212 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:06:44.213 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:06:44.214 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:44.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T19:06:44.432 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:44.432 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672969 2026-02-17T19:06:44.433 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:44.433 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:06:44.434 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672969 2026-02-17T19:06:44.434 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:44.435 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672969 2026-02-17T19:06:44.436 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-17T19:06:44.436 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672969 2026-02-17T19:06:44.436 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:06:44.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672969 -lt 42949672969 2026-02-17T19:06:44.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:44.660 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-17T19:06:44.660 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:44.662 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:06:44.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-17T19:06:44.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:44.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-17T19:06:44.664 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542152 2026-02-17T19:06:44.664 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-17T19:06:44.664 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:06:44.889 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-17T19:06:44.890 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:06:44.890 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:44.890 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:45.184 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:06:45.184 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:06:45.184 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:06:45.185 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:06:45.185 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:06:45.185 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:06:45.185 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:06:45.185 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:06:45.397 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:06:45.398 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:06:45.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:45.399 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:45.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:06:45.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:06:45.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:06:45.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-17T19:06:45.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-17T19:06:45.895 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:06:45.906 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-17T19:06:45.906 INFO:tasks.workunit.client.0.trial067.stdout:primary and soon to be divergent is 1 2026-02-17T19:06:45.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-17T19:06:45.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:06:46.114 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:06:46.114 INFO:tasks.workunit.client.0.trial067.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T19:06:35.859805+0000 0'0 28:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:00:56.203674+0000 0 0 2026-02-17T19:06:46.114 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:06:46.114 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:06:46.115 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:06:46.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-17T19:06:46.125 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-17T19:06:46.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-17T19:06:46.127 INFO:tasks.workunit.client.0.trial067.stdout:writing initial objects 2026-02-17T19:06:46.127 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-17T19:06:46.128 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.128 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.149 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.149 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.291 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.291 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.350 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.350 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.379 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.407 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.408 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.434 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.434 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.564 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.592 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.592 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.677 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.678 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.762 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.762 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.875 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.875 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.903 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.903 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.958 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.959 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:46.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:46.986 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.013 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.013 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.043 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.043 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.073 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.073 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.155 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.185 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.213 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.213 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.297 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.297 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.326 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.326 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.354 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.410 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.410 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.439 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.439 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.468 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.468 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.489 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.490 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.518 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.518 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.546 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.713 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.713 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.740 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.765 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.765 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.848 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.906 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.906 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.934 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.935 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.962 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:47.991 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:47.991 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.049 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.049 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.077 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.078 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.129 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.129 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.151 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.151 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.203 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.204 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.347 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.347 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.403 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.403 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.563 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.591 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.591 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.645 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.645 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.723 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.751 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.751 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.780 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.781 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.810 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T19:06:48.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:48.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:06:48.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-17T19:06:48.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:06:48.895 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:06:48.896 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:06:48.896 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:06:48.897 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:06:48.897 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:06:48.897 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:06:48.897 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:06:48.897 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:06:48.969 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:06:48.969 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:06:48.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:06:48.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:06:48.970 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:06:48.970 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:06:49.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:06:49.183 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:06:49.183 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:06:49.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:06:49.183 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:49.184 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:06:49.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-17T19:06:49.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-17T19:06:49.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T19:06:49.270 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:49.270 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:06:49.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672972 2026-02-17T19:06:49.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672972 2026-02-17T19:06:49.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2026-02-17T19:06:49.357 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:06:49.357 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:06:49.437 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-17T19:06:49.437 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-17T19:06:49.437 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-60129542156' 2026-02-17T19:06:49.438 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:49.438 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-17T19:06:49.438 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:49.438 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:06:49.439 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-17T19:06:49.439 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:49.441 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-17T19:06:49.441 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T19:06:49.441 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 21474836493 2026-02-17T19:06:49.441 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:49.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-17T19:06:49.661 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:06:50.661 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:06:50.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:06:50.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T19:06:50.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:50.878 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672972 2026-02-17T19:06:50.878 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:50.879 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:06:50.880 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672972 2026-02-17T19:06:50.880 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:50.882 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672972 2026-02-17T19:06:50.882 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-17T19:06:50.882 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 42949672972 2026-02-17T19:06:50.882 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:06:51.110 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-17T19:06:51.110 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:06:51.111 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-17T19:06:51.111 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:06:51.112 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:06:51.113 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-17T19:06:51.113 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:06:51.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-17T19:06:51.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-17T19:06:51.115 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 60129542156 2026-02-17T19:06:51.115 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:06:51.338 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-17T19:06:51.339 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:06:51.340 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:51.340 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:51.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:06:51.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:06:51.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:06:51.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:06:51.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:06:51.623 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:06:51.623 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:06:51.623 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:06:51.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:06:51.836 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:06:51.837 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:06:51.837 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T19:06:52.121 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T19:06:52.122 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T19:06:52.122 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T19:06:52.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-17T19:06:52.334 INFO:tasks.workunit.client.0.trial067.stdout:blackholing osds 0 2 2026-02-17T19:06:52.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-17T19:06:52.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:06:52.543 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:06:52.543 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T19:06:35.859805+0000 28'100 28:118 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:00:56.203674+0000 0 0 2026-02-17T19:06:52.544 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:06:52.544 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:06:52.544 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:06:52.552 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:06:52.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T19:06:52.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:06:52.553 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T19:06:52.554 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T19:06:52.608 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:06:52.609 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:06:52.609 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:06:52.614 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:06:52.615 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T19:06:52.615 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:06:52.615 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:06:52.615 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:06:52.615 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:06:52.616 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:06:52.616 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:06:52.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T19:06:52.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T19:06:52.668 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:06:52.668 INFO:tasks.workunit.client.0.trial067.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T19:06:52.668 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:06:52.674 INFO:tasks.workunit.client.0.trial067.stdout:writing divergent object 2026-02-17T19:06:52.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-17T19:06:52.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-17T19:06:52.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.8ofAA0cjKS 2026-02-17T19:06:53.676 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-17T19:06:53.676 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.ayotjyc1YF 2026-02-17T19:06:53.784 INFO:tasks.workunit.client.0.trial067.stdout:created pool test snap snap1 2026-02-17T19:06:53.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-17T19:06:53.787 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-17T19:06:53.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.ayotjyc1YF 2026-02-17T19:07:03.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-17T19:07:03.836 INFO:tasks.workunit.client.0.trial067.stderr:rados: no process found 2026-02-17T19:07:03.837 INFO:tasks.workunit.client.0.trial067.stdout:killing all the osds 2026-02-17T19:07:03.837 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-17T19:07:03.838 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:07:04.061 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:07:04.061 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-17T19:06:35.859805+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:13:31.979358+0000 0 0 2026-02-17T19:07:04.061 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:07:04.061 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:07:04.062 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:07:04.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-17T19:07:04.070 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:07:04.070 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:07:04.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:07:04.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:07:04.071 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:07:04.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:07:04.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T19:07:04.181 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-17T19:07:04.448 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already down. 2026-02-17T19:07:04.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T19:07:04.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-17T19:07:04.743 INFO:tasks.workunit.client.0.trial067.stderr:osd.1 is already down. 2026-02-17T19:07:04.752 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T19:07:04.752 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-17T19:07:05.018 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already down. 2026-02-17T19:07:05.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:05.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-17T19:07:05.293 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already out. 2026-02-17T19:07:05.304 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:05.304 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-17T19:07:05.579 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already out. 2026-02-17T19:07:05.589 INFO:tasks.workunit.client.0.trial067.stdout:bringing up non_divergent 0 2 2026-02-17T19:07:05.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-17T19:07:05.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:07:05.806 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:07:05.806 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-17T19:06:35.859805+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T23:13:31.979358+0000 0 0 2026-02-17T19:07:05.806 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:07:05.806 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:07:05.806 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:07:05.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:07:05.819 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:07:05.820 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:07:05.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:07:05.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:07:05.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:07:05.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:07:05.821 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:07:05.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:07:05.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:07:05.823 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T19:07:05.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:07:05.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:07:05.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:07:05.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:07:05.848 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:05.833+0000 7f2afa89ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:05.849 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:05.837+0000 7f2afa89ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:05.850 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:05.837+0000 7f2afa89ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:07:06.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:06.036 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:07:06.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:07:06.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:06.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:07:06.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:07:06.286 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:06.273+0000 7f2afa89ea40 -1 Falling back to public interface 2026-02-17T19:07:06.970 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:06.957+0000 7f2afa89ea40 -1 osd.0 28 log_to_monitors true 2026-02-17T19:07:07.258 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:07:07.258 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:07.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:07:07.259 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:07:07.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:07.260 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:07:07.476 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/1281291990,v1:127.0.0.1:6801/1281291990] [v2:127.0.0.1:6802/1281291990,v1:127.0.0.1:6803/1281291990] exists,up 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:07:07.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:07:07.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:07:07.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:07:07.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:07.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:07:07.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:07:07.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:07:07.482 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:07:07.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:07:07.484 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:07:07.501 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:07.489+0000 7fa3887aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:07.503 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:07.489+0000 7fa3887aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:07.504 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:07.489+0000 7fa3887aca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:07.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:07:07.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:07:07.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:07:07.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:07:07.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:07:07.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:07.696 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:07:07.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:07:07.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:07.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:07:07.862 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:07.849+0000 7fa3887aca40 -1 Falling back to public interface 2026-02-17T19:07:07.918 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:07:08.511 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:08.497+0000 7fa3887aca40 -1 osd.2 28 log_to_monitors true 2026-02-17T19:07:08.919 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:07:08.919 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:08.920 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:07:08.920 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:07:08.920 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:08.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:07:09.138 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/2366121627,v1:127.0.0.1:6811/2366121627] [v2:127.0.0.1:6812/2366121627,v1:127.0.0.1:6813/2366121627] exists,up 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:07:09.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:07:09.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:07:09.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:07:09.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:09.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-17T19:07:09.385 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already in. 2026-02-17T19:07:09.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:09.395 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-17T19:07:09.670 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already in. 2026-02-17T19:07:09.681 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-17T19:07:14.683 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-17T19:07:14.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-17T19:07:14.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-17T19:07:14.685 INFO:tasks.workunit.client.0.trial067.stdout:writing non-divergent object existing_4 2026-02-17T19:07:14.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:07:14.885 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:07:14.886 INFO:tasks.workunit.client.0.trial067.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T19:07:09.712281+0000 28'100 41:128 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:55:10.274031+0000 0 0 2026-02-17T19:07:14.886 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:07:14.886 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:07:14.886 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:07:14.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.8ofAA0cjKS 2026-02-17T19:07:14.925 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.8ofAA0cjKS 2026-02-17T19:07:14.926 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:07:14.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-17T19:07:14.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:07:14.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:07:14.927 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:07:14.928 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:07:15.000 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:07:15.000 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:07:15.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:07:15.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:07:15.001 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:07:15.001 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:07:15.222 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:07:15.222 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:07:15.223 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:07:15.223 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:07:15.223 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:15.223 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:07:15.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-17T19:07:15.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-17T19:07:15.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660' 2026-02-17T19:07:15.308 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:15.308 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:15.372 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757252 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757252 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660 2-163208757252' 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822660 2026-02-17T19:07:15.454 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:07:15.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:07:15.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822660 2026-02-17T19:07:15.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:07:15.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822660 2026-02-17T19:07:15.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-17T19:07:15.458 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 154618822660 2026-02-17T19:07:15.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:07:15.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-17T19:07:15.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:07:16.688 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:07:16.689 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:07:16.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-17T19:07:16.907 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:07:16.907 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757252 2026-02-17T19:07:16.908 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:07:16.908 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:07:16.909 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757252 2026-02-17T19:07:16.909 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:07:16.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757252 2026-02-17T19:07:16.911 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 163208757252 2026-02-17T19:07:16.911 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757252' 2026-02-17T19:07:16.912 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:07:17.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757252 -lt 163208757252 2026-02-17T19:07:17.142 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:07:17.142 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:17.142 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:17.430 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:17.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:17.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:17.651 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:17.652 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:17.652 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:17.652 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:17.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:17.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:07:17.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:07:17.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:07:17.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:17.941 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:07:18.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:18.042 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:18.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:18.258 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:18.258 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:18.258 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:18.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:18.549 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:18.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:18.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:18.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:07:18.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:18.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:07:19.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:19.037 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:19.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:19.249 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:19.249 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:19.250 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:19.250 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:19.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:19.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:19.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:19.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:19.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:19.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:07:19.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:19.818 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:07:20.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:20.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:20.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:20.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:20.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:20.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:20.220 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:20.221 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:20.442 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:20.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:20.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:20.443 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:20.730 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:20.731 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:20.731 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:20.731 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:21.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:21.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:21.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:07:21.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:21.021 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:07:21.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:21.821 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:21.822 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:21.822 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:21.822 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:21.822 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:21.823 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:21.823 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:22.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:22.035 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:22.035 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:22.035 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:22.314 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:22.315 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:22.315 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:22.315 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:22.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:22.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:22.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:07:22.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:22.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:07:24.203 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:24.203 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:24.204 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:24.204 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:24.205 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:24.205 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:24.205 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:24.205 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:24.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:24.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:24.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:24.416 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:24.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:24.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:24.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:24.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:24.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:07:24.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:24.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:07:28.174 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:28.175 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:28.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:28.392 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:28.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:28.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:28.393 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:28.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:28.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:28.697 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:28.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:28.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:28.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:07:28.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:28.984 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:07:35.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:35.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:35.386 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:35.386 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:35.386 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:35.386 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:35.386 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:35.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:35.605 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:35.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:35.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:35.606 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:35.899 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:35.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:36.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:36.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:36.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:07:36.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:36.182 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:07:43.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:43.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:43.483 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:43.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:43.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:43.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:43.484 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:43.485 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:43.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:43.706 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:43.707 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:43.707 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:43.995 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:43.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:43.997 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:43.997 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:44.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:44.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:44.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:07:44.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "b675f83e-4de7-4f21-b6eb-797a08cb25a1", 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:07:44.556206+0000", 2026-02-17T19:07:44.566 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:07:44.567 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.568 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.569 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:06:23.107400Z", 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:06:23.107400Z", 2026-02-17T19:07:44.570 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:07:44.571 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.572 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.573 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:06:23:107395+0000", 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.574 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 41, 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:06:23.188290+0000", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:07:09.708198+0000", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:07:08.660028+0000", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:07:09.604789+0000", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:07:44.575 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 10, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:07:44.576 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:06:35.297226+0000", 2026-02-17T19:07:44.577 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 16389, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "type": 3, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 1, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:07:44.578 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "off", 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 1, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 1, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 1, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 1, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:07:44.579 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "29", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "pool", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 1, 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 29, 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [ 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "snapid": 1, 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "stamp": "2026-02-17T19:06:53.687151+0000", 2026-02-17T19:07:44.580 INFO:tasks.workunit.client.0.trial067.stdout: "name": "snap1" 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:07:44.581 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "myprofile", 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:07:44.582 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 8192, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {} 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.583 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "561792a7-31f4-4230-b33b-f7e7da1f979c", 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 5, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 36, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 40, 2026-02-17T19:07:44.584 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 30, 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:07:44.585 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.586 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.587 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.588 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 1281291990 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/1281291990", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/1281291990", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1281291990", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1281291990", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:07:44.589 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "f7a394e4-d8a0-468e-b55e-1236bf3b4d00", 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 10, 2026-02-17T19:07:44.590 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 24, 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:07:44.591 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.592 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.593 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.594 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/2613418791", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/2613418791", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2613418791", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2613418791", 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:07:44.595 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "4dbf484c-66f7-4174-8ed1-5edd567d6ace", 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 14, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 28, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 38, 2026-02-17T19:07:44.596 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 32, 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:07:44.597 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:07:44.598 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.599 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2366121627 2026-02-17T19:07:44.600 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/2366121627", 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/2366121627", 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2366121627", 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2366121627", 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.601 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:04.380463+0000", 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:06:26.849916+0000", 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:04.675104+0000", 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:07:44.602 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:04.951792+0000", 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:06:33.015662+0000", 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:07:44.603 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "myprofile": { 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "crush-device-class": "", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "crush-failure-domain": "osd", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "crush-num-failure-domains": "0", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "crush-root": "default", 2026-02-17T19:07:44.604 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "m": "1", 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:07:44.605 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/1281291990,v1:127.0.0.1:6803/1281291990]", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:07:44.606 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:24.119754Z", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:07:44.607 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/1281291990,v1:127.0.0.1:6801/1281291990]", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1281291990,v1:127.0.0.1:6807/1281291990]", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1281291990,v1:127.0.0.1:6805/1281291990]", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:07:44.608 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/2613418791,v1:127.0.0.1:6813/2613418791]", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:07:44.609 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:27.770423Z", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/2613418791,v1:127.0.0.1:6811/2613418791]", 2026-02-17T19:07:44.610 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2613418791,v1:127.0.0.1:6817/2613418791]", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2613418791,v1:127.0.0.1:6815/2613418791]", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:07:44.611 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/2366121627,v1:127.0.0.1:6813/2366121627]", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:07:44.612 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:30.601684Z", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/2366121627,v1:127.0.0.1:6811/2366121627]", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2366121627,v1:127.0.0.1:6817/2366121627]", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2366121627,v1:127.0.0.1:6815/2366121627]", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:07:44.613 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 0, 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [] 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 36 2026-02-17T19:07:44.614 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 39 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 41, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.615 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:07:44.616 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:07:44.617 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.618 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:07:44.619 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.620 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.621 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 1, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "test", 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "type": 3, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "op": "set_chooseleaf_tries", 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "num": 5 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "op": "set_choose_tries", 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "num": 100 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:07:44.622 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_indep", 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stderr:report 2102932724 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.623 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.624 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:06:23:188058+0000", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:07:44.625 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 52200, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 101, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 1, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 303, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 101, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 101, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:07:44.626 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:07:44.627 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 18, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 18, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "up": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83900, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2124, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488900, 2026-02-17T19:07:44.628 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036633600, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2174976, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1534810, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 27717, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661755 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:07:44.629 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 83900, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2124, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 27, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 81700, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314488900, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322036633600, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2174976, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1534810, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 27717, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 83661755 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:07:44.630 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 52200, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 101, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 1, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 303, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 101, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 101, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:07:44.631 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1241088, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1241088, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:07:44.632 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 18, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 18, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "up": 3, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 3, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 154618822666 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 42949672975 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 163208757258 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:07:44.633 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2147483647, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 1, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:07:44.634 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 3, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:07:31.626355+0000", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "0": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 41, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:07:44.635 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 240, 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 332, 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:07:44.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:07:44.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:07:44.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-17T19:07:44.684 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:07:44.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:07:44.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T19:07:44.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:07:44.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-17T19:07:44.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-17T19:07:44.884 INFO:tasks.workunit.client.0.trial067.stderr:PG '1.0' not found 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:07:44.988 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:07:44.989 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:07:44.990 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T19:07:44.991 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:07:44.991 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:07:44.991 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:07:44.991 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T19:07:44.992 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:07:44.992 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:07:44.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:07:44.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:07:45.014 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.002+0000 7fb7caa6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:45.015 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.002+0000 7fb7caa6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:45.016 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.006+0000 7fb7caa6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:45.209 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:07:45.210 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:07:45.210 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:07:45.210 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:45.211 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:07:45.397 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.386+0000 7fb7caa6ba40 -1 Falling back to public interface 2026-02-17T19:07:45.429 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 36 up_thru 40 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/1281291990,v1:127.0.0.1:6801/1281291990] [v2:127.0.0.1:6802/1281291990,v1:127.0.0.1:6803/1281291990] exists,up 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:07:45.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:07:45.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:07:45.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:07:45.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:07:45.430 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-17T19:07:45.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:07:45.431 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:07:45.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:07:45.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:07:45.431 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:07:45.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:07:45.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-17T19:07:45.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:07:45.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:07:45.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T19:07:45.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:07:45.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-17T19:07:45.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-17T19:07:45.727 INFO:tasks.workunit.client.0.trial067.stderr:PG '1.0' not found 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:07:45.812 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:07:45.813 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:07:45.814 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T19:07:45.815 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:07:45.815 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:07:45.815 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:07:45.815 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T19:07:45.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:07:45.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:07:45.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:07:45.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:07:45.833 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.822+0000 7f16ef364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:45.835 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.822+0000 7f16ef364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:45.836 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:45.826+0000 7f16ef364a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:07:46.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:07:46.173 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:46.162+0000 7fb7caa6ba40 -1 osd.0 41 log_to_monitors true 2026-02-17T19:07:46.221 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:46.210+0000 7f16ef364a40 -1 Falling back to public interface 2026-02-17T19:07:46.253 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/2366121627,v1:127.0.0.1:6811/2366121627] [v2:127.0.0.1:6812/2366121627,v1:127.0.0.1:6813/2366121627] exists,up 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:07:46.254 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T19:07:46.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-17T19:07:46.490 INFO:tasks.workunit.client.0.trial067.stderr:PG '1.0' not found 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:07:46.569 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:07:46.570 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T19:07:46.571 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:07:46.571 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:07:46.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:07:46.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:07:46.572 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:07:46.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T19:07:46.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:07:46.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:07:46.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:07:46.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:07:46.641 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:07:46.863 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:07:46.864 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:07:46.864 INFO:tasks.workunit.client.0.trial067.stderr:2' 2026-02-17T19:07:46.864 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:07:46.864 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:46.864 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:07:46.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561027 2026-02-17T19:07:46.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561027 2026-02-17T19:07:46.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561027' 2026-02-17T19:07:46.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:46.951 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:07:47.015 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T19:07:47.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T19:07:47.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T19:07:47.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T19:07:47.016 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:07:47.016 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:07:47.050 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:07:47.038+0000 7f16ef364a40 -1 osd.2 41 log_to_monitors true 2026-02-17T19:07:52.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430211 2026-02-17T19:07:52.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430211 2026-02-17T19:07:52.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561027 2-206158430211' 2026-02-17T19:07:52.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:07:52.103 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561027 2026-02-17T19:07:52.103 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:07:52.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:07:52.104 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561027 2026-02-17T19:07:52.104 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:07:52.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561027 2026-02-17T19:07:52.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561027' 2026-02-17T19:07:52.106 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 188978561027 2026-02-17T19:07:52.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:07:52.320 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561028 -lt 188978561027 2026-02-17T19:07:52.320 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:07:52.320 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-206158430211 2026-02-17T19:07:52.321 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:07:52.321 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:07:52.322 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430211 2026-02-17T19:07:52.322 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:07:52.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=206158430211 2026-02-17T19:07:52.324 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 206158430211 2026-02-17T19:07:52.324 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 206158430211' 2026-02-17T19:07:52.324 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:07:52.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 206158430211 2026-02-17T19:07:52.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:07:53.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:07:53.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:07:53.759 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 206158430212 -lt 206158430211 2026-02-17T19:07:53.759 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:07:53.760 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:53.760 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:54.045 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:07:54.045 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:54.045 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:54.045 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:54.045 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:54.046 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:54.046 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:54.046 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:54.255 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:54.256 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:54.256 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:54.257 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:54.538 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T19:07:54.638 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:54.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:54.640 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:54.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:54.851 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:54.851 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:54.852 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:55.130 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:55.131 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:55.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:55.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:55.419 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T19:07:55.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:55.420 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T19:07:55.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:55.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:55.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:55.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:55.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:55.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:55.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:55.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:55.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:55.832 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:55.833 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:55.833 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:56.118 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:56.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:56.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:56.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T19:07:56.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:56.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T19:07:56.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:56.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:56.808 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:57.025 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:57.026 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:57.026 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:57.026 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:57.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:57.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:57.318 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:57.602 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:57.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:57.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T19:07:57.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:57.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T19:07:58.404 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:07:58.405 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:07:58.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:07:58.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:07:58.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:07:58.405 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:07:58.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:07:58.406 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:07:58.625 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:07:58.626 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:07:58.626 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:07:58.626 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:07:58.922 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:07:59.215 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:07:59.215 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:07:59.215 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T19:07:59.215 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:07:59.215 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T19:08:00.815 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:08:00.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:08:00.816 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:08:00.816 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:08:00.816 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:08:00.816 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:08:00.817 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:08:00.817 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:08:01.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:08:01.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:08:01.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:08:01.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:08:01.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:08:01.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:08:01.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:08:01.626 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:08:01.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:08:01.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T19:08:01.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:08:01.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T19:08:04.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:08:04.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:08:04.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:08:04.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:08:04.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:08:04.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:08:04.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:08:04.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:08:05.048 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:08:05.049 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:08:05.049 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:08:05.049 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:08:05.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:08:05.338 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:08:05.338 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:08:05.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:08:05.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:08:05.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T19:08:05.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:08:05.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T19:08:12.018 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:08:12.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:08:12.020 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:08:12.241 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:08:12.242 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:08:12.242 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:08:12.242 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:08:12.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:08:12.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:08:12.537 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:08:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:08:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:08:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T19:08:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T19:08:12.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T19:08:20.131 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T19:08:20.132 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:08:20.133 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:08:20.349 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T19:08:20.350 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:08:20.350 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:08:20.350 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:08:20.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T19:08:20.641 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T19:08:20.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T19:08:20.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T19:08:20.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T19:08:20.923 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T19:08:21.206 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_fingerprint": "b675f83e-4de7-4f21-b6eb-797a08cb25a1", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "timestamp": "2026-02-17T19:08:21.197388+0000", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "tag": "", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "health": { 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "status": "HEALTH_WARN", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "checks": { 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "OSDMAP_FLAGS": { 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:08:21.207 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "count": 17 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [], 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "OSD_DOWN": { 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "message": "1 osds down", 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:08:21.208 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "message": "osd.1 (root=default,host=trial067) is down" 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "PG_DEGRADED": { 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "severity": "HEALTH_WARN", 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "summary": { 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T19:08:21.209 INFO:tasks.workunit.client.0.trial067.stdout: "count": 1 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: "detail": [ 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: "muted": false 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: "mutes": [] 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.210 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_first_committed": 1, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "monmap_last_committed": 1, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "monmap": { 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:06:23.107400Z", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:06:23.107400Z", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release": 20, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "min_mon_release_name": "tentacle", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "election_strategy": 1, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "disallowed_leaders": "", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": false, 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "tiebreaker_mon": "", 2026-02-17T19:08:21.211 INFO:tasks.workunit.client.0.trial067.stdout: "removed_ranks": "", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "features": { 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "persistent": [ 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "kraken", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "luminous", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "mimic", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap-prune", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "nautilus", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "octopus", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "pacific", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "elector-pinging", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "quincy", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "reef", 2026-02-17T19:08:21.212 INFO:tasks.workunit.client.0.trial067.stdout: "squid", 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "tentacle", 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "nvmeof_beacon_diff" 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "optional": [] 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "mons": [ 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "rank": 0, 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "name": "a", 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.213 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115", 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 0 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "priority": 0, 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 0, 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "time_added": "2026-02-17T19:06:23:107395+0000", 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: "crush_location": [] 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.214 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "quorum": [ 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: 0 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap": { 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 49, 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "fsid": "84f14964-cea1-4e56-9433-4d1b03bf4049", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "created": "2026-02-17T19:06:23.188290+0000", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:07:47.400648+0000", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "last_up_change": "2026-02-17T19:07:47.298568+0000", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "last_in_change": "2026-02-17T19:07:09.604789+0000", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T19:08:21.215 INFO:tasks.workunit.client.0.trial067.stdout: "flags_num": 5800384, 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "flags_set": [ 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "nodown", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "noin", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "noout", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "pglog_hardlimit", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snapdirs", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "recovery_deletes", 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "sortbitwise" 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "crush_version": 12, 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T19:08:21.216 INFO:tasks.workunit.client.0.trial067.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_snapshot": "", 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "pool_max": 1, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "max_osd": 3, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "require_min_compat_client": "luminous", 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "min_compat_client": "jewel", 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "require_osd_release": "tentacle", 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "allow_crimson": false, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "pools": [ 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "pool_name": "test", 2026-02-17T19:08:21.217 INFO:tasks.workunit.client.0.trial067.stdout: "create_time": "2026-02-17T19:06:35.297226+0000", 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "flags": 16389, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "type": 3, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "size": 3, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "min_size": 2, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "crush_rule": 1, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_count": 0, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_target": 0, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "is_stretch_pool": false, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "object_hash": 2, 2026-02-17T19:08:21.218 INFO:tasks.workunit.client.0.trial067.stdout: "pg_autoscale_mode": "off", 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num": 1, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num": 1, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "pg_placement_num_target": 1, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_target": 1, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "pg_num_pending": 1, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "last_pg_merge_meta": { 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "source_pgid": "0.0", 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "ready_epoch": 0, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_started": 0, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": 0, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "source_version": "0'0", 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "target_version": "0'0" 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.219 INFO:tasks.workunit.client.0.trial067.stdout: "last_change": "29", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend": "0", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "auid": 0, 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "snap_mode": "pool", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "snap_seq": 1, 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "snap_epoch": 29, 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "pool_snaps": [ 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "snapid": 1, 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "stamp": "2026-02-17T19:06:53.687151+0000", 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: "name": "snap1" 2026-02-17T19:08:21.220 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps": "[]", 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_bytes": 0, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "quota_max_objects": 0, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "tiers": [], 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "tier_of": -1, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "read_tier": -1, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "write_tier": -1, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "cache_mode": "none", 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_bytes": 0, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "target_max_objects": 0, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T19:08:21.221 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_flush_age": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "cache_min_evict_age": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profile": "myprofile", 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_params": { 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "type": "none" 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_period": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_count": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "use_gmt_hitset": true, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "min_read_recency_for_promote": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "min_write_recency_for_promote": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T19:08:21.222 INFO:tasks.workunit.client.0.trial067.stdout: "hit_set_search_last_n": 0, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "grade_table": [], 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "stripe_width": 8192, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "expected_num_objects": 0, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "fast_read": false, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "nonprimary_shards": "{}", 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "options": {}, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "application_metadata": {} 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "osds": [ 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:08:21.223 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "561792a7-31f4-4230-b33b-f7e7da1f979c", 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 36, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 41, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 44, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 48, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 43, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.224 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6800", 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6801", 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.225 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6802", 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6803", 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.226 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6806", 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6807", 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.227 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6804", 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6805", 2026-02-17T19:08:21.228 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2079657828 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6801/2079657828", 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6803/2079657828", 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2079657828", 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2079657828", 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.229 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "f7a394e4-d8a0-468e-b55e-1236bf3b4d00", 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "up": 0, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 0, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 0, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 10, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 24, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 31, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:08:21.230 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.231 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.232 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.233 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:08:21.234 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 2613418791 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/2613418791", 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/2613418791", 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2613418791", 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2613418791", 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "exists" 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.235 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "uuid": "4dbf484c-66f7-4174-8ed1-5edd567d6ace", 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "up": 1, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "in": 1, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 1, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "primary_affinity": 1, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_begin": 38, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "last_clean_end": 41, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 48, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "up_thru": 0, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "down_at": 47, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "lost_at": 0, 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "public_addrs": { 2026-02-17T19:08:21.236 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6810", 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6811", 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addrs": { 2026-02-17T19:08:21.237 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6812", 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6813", 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.238 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addrs": { 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6816", 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6817", 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.239 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addrs": { 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "addrvec": [ 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v2", 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6814", 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "type": "v1", 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "127.0.0.1:6815", 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: "nonce": 450463243 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.240 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "public_addr": "127.0.0.1:6811/450463243", 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "cluster_addr": "127.0.0.1:6813/450463243", 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_back_addr": "127.0.0.1:6817/450463243", 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "heartbeat_front_addr": "127.0.0.1:6815/450463243", 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "state": [ 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "exists", 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "up" 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "osd_xinfo": [ 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.241 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:46.320299+0000", 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:06:26.849916+0000", 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:04.675104+0000", 2026-02-17T19:08:21.242 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "down_stamp": "2026-02-17T19:07:47.196678+0000", 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_probability": 0, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "laggy_interval": 0, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "features": 4544132024016699391, 2026-02-17T19:08:21.243 INFO:tasks.workunit.client.0.trial067.stdout: "old_weight": 0, 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "last_purged_snaps_scrub": "2026-02-17T19:06:33.015662+0000", 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "dead_epoch": 0 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap": [], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_items": [], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "pg_upmap_primaries": [], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "pg_temp": [], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "primary_temp": [], 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "blocklist": {}, 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "range_blocklist": {}, 2026-02-17T19:08:21.244 INFO:tasks.workunit.client.0.trial067.stdout: "erasure_code_profiles": { 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "default": { 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "m": "2", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "myprofile": { 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "crush-device-class": "", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "crush-failure-domain": "osd", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "crush-num-failure-domains": "0", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "crush-root": "default", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "k": "2", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "m": "1", 2026-02-17T19:08:21.245 INFO:tasks.workunit.client.0.trial067.stdout: "plugin": "isa", 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "technique": "reed_sol_van" 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "removed_snaps_queue": [], 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "new_removed_snaps": [], 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "new_purged_snaps": [], 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "crush_node_flags": {}, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "device_class_flags": {}, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode": { 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_enabled": false, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_bucket_count": 0, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "degraded_stretch_mode": 0, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "recovering_stretch_mode": 0, 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: "stretch_mode_bucket": 0 2026-02-17T19:08:21.246 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "osd_metadata": [ 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6802/2079657828,v1:127.0.0.1:6803/2079657828]", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:08:21.247 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.248 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:24.119754Z", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6800/2079657828,v1:127.0.0.1:6801/2079657828]", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2079657828,v1:127.0.0.1:6807/2079657828]", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2079657828,v1:127.0.0.1:6805/2079657828]", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:08:21.249 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:08:21.250 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/2613418791,v1:127.0.0.1:6813/2613418791]", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:08:21.251 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:27.770423Z", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/2613418791,v1:127.0.0.1:6811/2613418791]", 2026-02-17T19:08:21.252 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2613418791,v1:127.0.0.1:6817/2613418791]", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2613418791,v1:127.0.0.1:6815/2613418791]", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:08:21.253 INFO:tasks.workunit.client.0.trial067.stdout: "arch": "x86_64", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "back_addr": "[v2:127.0.0.1:6812/450463243,v1:127.0.0.1:6813/450463243]", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "back_iface": "", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs": "1", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_db": "0", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluefs_single_shared_device": "1", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_allocator": "hybrid", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T19:08:21.254 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "bluestore_write_mode": "classic", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_release": "tentacle", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None)", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "created_at": "2026-02-17T19:06:30.601684Z", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "default_device_class": "ssd", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD4835", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "devices": "nvme0n1", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "distro": "ubuntu", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "distro_version": "22.04", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "front_addr": "[v2:127.0.0.1:6810/450463243,v1:127.0.0.1:6811/450463243]", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "front_iface": "", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/450463243,v1:127.0.0.1:6817/450463243]", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/450463243,v1:127.0.0.1:6815/450463243]", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "hostname": "trial067", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "journal_rotational": "0", 2026-02-17T19:08:21.255 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "mem_swap_kb": "8388604", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "mem_total_kb": "130961704", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_node": "0", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "objectstore_numa_nodes": "0", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "os": "Linux", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "osd_objectstore": "bluestore", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "osdspec_affinity": "", 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "rotational": "0" 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_clean_epochs": { 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "min_last_epoch_clean": 25, 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "last_epoch_clean": { 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "per_pool": [ 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: "floor": 25 2026-02-17T19:08:21.256 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "osd_epochs": [ 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 46 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 49 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_first_committed": 1, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "osdmap_last_committed": 49, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "crushmap": { 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "devices": [ 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.0", 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.257 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.1", 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd.2", 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "class": "ssd" 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "types": [ 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 0, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "name": "osd" 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "name": "host" 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 2, 2026-02-17T19:08:21.258 INFO:tasks.workunit.client.0.trial067.stdout: "name": "chassis" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 3, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "name": "rack" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 4, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "name": "row" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 5, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pdu" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 6, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "name": "pod" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 7, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "name": "room" 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.259 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 8, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "name": "datacenter" 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 9, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "name": "zone" 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 10, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "name": "region" 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "name": "root" 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "buckets": [ 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "id": -1, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default", 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:08:21.260 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "id": -2, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "name": "default~ssd", 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 11, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "root", 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.261 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "id": -3, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067", 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.262 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "id": -4, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "name": "trial067~ssd", 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "type_id": 1, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "type_name": "host", 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 19206, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "alg": "straw2", 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "hash": "rjenkins1", 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "items": [ 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "id": 0, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 0 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "id": 1, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 1 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "id": 2, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "weight": 6402, 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: "pos": 2 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.263 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "rules": [ 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 0, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "replicated_rule", 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "type": 1, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_firstn", 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "rule_id": 1, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "rule_name": "test", 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "type": 3, 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: "steps": [ 2026-02-17T19:08:21.264 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "op": "set_chooseleaf_tries", 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "num": 5 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "op": "set_choose_tries", 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "num": 100 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "op": "take", 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "item": -1, 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "item_name": "default" 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "op": "choose_indep", 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "num": 0, 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stdout: "type": "osd" 2026-02-17T19:08:21.265 INFO:tasks.workunit.client.0.trial067.stderr:report 423454131 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "op": "emit" 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: ] 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "tunables": { 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_tries": 0, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "choose_local_fallback_tries": 0, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "choose_total_tries": 50, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_descend_once": 1, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_vary_r": 1, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "chooseleaf_stable": 1, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "msr_descents": 100, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "msr_collision_tries": 100, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "straw_calc_version": 1, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "allowed_bucket_algs": 54, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "profile": "jewel", 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "optimal_tunables": 1, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "legacy_tunables": 0, 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "minimum_required_version": "jewel", 2026-02-17T19:08:21.266 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables2": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "has_v2_rules": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables3": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "has_v3_rules": 0, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "has_v4_buckets": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "require_feature_tunables5": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "has_v5_rules": 0, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "has_msr_rules": 0 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "choose_args": {} 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "fsmap": { 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "btime": "2026-02-17T19:06:23:188058+0000", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "default_fscid": -1, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "compat": { 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "compat": {}, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "ro_compat": {}, 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "incompat": { 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_1": "base v0.20", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_2": "client writeable ranges", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_4": "dir inode in separate object", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T19:08:21.267 INFO:tasks.workunit.client.0.trial067.stdout: "feature_8": "no anchor table", 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "feature_9": "file layout v2", 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "feature_10": "snaprealm v2", 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "feature_11": "minor log segments", 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "feature_flags": { 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "enable_multiple": true, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "ever_enabled_multiple": true 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "standbys": [], 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "filesystems": [] 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_first_committed": 1, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "mdsmap_last_committed": 1, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "auth": { 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 5, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_secrets": 3 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_active": 1, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_unknown": 0, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_osd": 3, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "pool_sum": { 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 52200, 2026-02-17T19:08:21.268 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 101, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 1, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 303, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 101, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 101, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:08:21.269 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 18, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 18, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "up": 3, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 3, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 0 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum": { 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:08:21.270 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 85052, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2252, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 31, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 82720, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314487748, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322035453952, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2306048, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1588750, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 32252, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 84705796 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:08:21.271 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "osd_sum_by_class": { 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "ssd": { 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "up_from": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "num_pgs": 3, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "num_osds": 3, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_osds": 3, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb": 314572800, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used": 85052, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_data": 2252, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_omap": 31, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb_used_meta": 82720, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "kb_avail": 314487748, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "statfs": { 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "total": 322122547200, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "available": 322035453952, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 2306048, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1588750, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:08:21.272 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 32252, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 84705796 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "hb_peers": [], 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "snap_trim_queue_len": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_snap_trimming": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_shards_repaired": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "op_queue_age_hist": { 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "histogram": [], 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "upper_bound": 1 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "perf_stat": { 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ms": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ms": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "commit_latency_ns": 0, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "apply_latency_ns": 0 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "alerts": [], 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "network_ping_times": [] 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "pool_stats": [ 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": 1, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg": 1, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "stat_sum": { 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes": 52200, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects": 101, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_clones": 1, 2026-02-17T19:08:21.273 INFO:tasks.workunit.client.0.trial067.stdout: "num_object_copies": 303, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_missing": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_degraded": 101, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_misplaced": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_unfound": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_dirty": 101, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_whiteouts": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_read": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_read_kb": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_write": 101, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_write_kb": 101, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_scrub_errors": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_deep_scrub_errors": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_recovered": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_recovered": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_keys_recovered": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_omap": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_kb": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_kb": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_promote": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_high": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_flush_mode_low": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_some": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_evict_mode_full": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_pinned": 0, 2026-02-17T19:08:21.274 INFO:tasks.workunit.client.0.trial067.stdout: "num_legacy_snapsets": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_large_omap_objects": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_manifest": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_bytes": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_omap_keys": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_objects_repaired": 0 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "store_stats": { 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "total": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "available": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "internally_reserved": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "allocated": 1241088, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "data_stored": 1241088, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_allocated": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "data_compressed_original": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "omap_allocated": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "internal_metadata": 0 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "log_size": 18, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "ondisk_log_size": 18, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "up": 3, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "acting": 3, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "num_store_stats": 3 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "osd_stats": [ 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 188978561033 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.275 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 42949672975 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "seq": 206158430217 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_state": [ 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "state": "active+undersized+degraded", 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num": 1 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "pool_pg_unavailable_map": [ 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "poolid": "1", 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "pgs": [] 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_pg_by_osd": [ 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2147483647, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 2, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.276 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 0, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 1, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 1, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "osd": 1, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_primary_pg": 0, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_acting_pg": 0, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "num_up_not_acting_pg": 0 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": [ 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "pool": 1, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "purged_snaps": {} 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: ], 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "servicemap": { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "epoch": 3, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "modified": "2026-02-17T19:07:31.626355+0000", 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "services": { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "osd": { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "daemons": { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "summary": "", 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "0": { 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.277 INFO:tasks.workunit.client.0.trial067.stdout: "2": { 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "start_epoch": 0, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "start_stamp": "0.000000", 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "gid": 0, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "metadata": {}, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "task_status": {} 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: }, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_first_committed": 1, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "mgrstat_last_committed": 59, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "logm_first_committed": 1, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "logm_last_committed": 320, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "paxos": { 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "first_committed": 1, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "last_committed": 438, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "last_pn": 0, 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: "accepted_pn": 0 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout: } 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T19:08:21.278 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery 2026-02-17T19:08:21.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-17T19:08:21.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:21.432 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:21.432 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 49:143 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:21.433 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:21.433 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:21.433 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:21.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:08:21.444 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T19:08:21.444 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T19:08:21.444 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.0.asok 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T19:08:21.445 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T19:08:21.511 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:08:21.517 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T19:08:21.518 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T19:08:21.518 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T19:08:21.518 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.2.asok 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T19:08:21.519 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T19:08:21.576 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:08:21.582 INFO:tasks.workunit.client.0.trial067.stdout:revive divergent 1 2026-02-17T19:08:21.582 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-17T19:08:21.582 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:21.795 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:21.795 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 49:143 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:21.795 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:21.795 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:21.796 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:21.806 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-17T19:08:22.121 INFO:tasks.workunit.client.0.trial067.stderr:noup is set 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:08:22.138 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:22.139 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:08:22.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:08:22.141 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:08:22.142 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:08:22.159 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:22.150+0000 7f4cc5bbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:22.160 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:22.150+0000 7f4cc5bbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:22.161 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:22.150+0000 7f4cc5bbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:22.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T19:08:22.356 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-17T19:08:22.476 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:22.466+0000 7f4cc5bbea40 -1 Falling back to public interface 2026-02-17T19:08:23.121 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:23.110+0000 7f4cc5bbea40 -1 osd.1 29 log_to_monitors true 2026-02-17T19:08:27.357 INFO:tasks.workunit.client.0.trial067.stdout:delay recovery divergent 2026-02-17T19:08:27.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-17T19:08:27.358 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:27.563 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:27.564 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 49:143 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:27.564 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:27.564 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:27.564 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:27.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-17T19:08:27.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T19:08:27.573 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T19:08:27.573 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:08:27.573 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:27.574 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:27.574 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16378/ceph-osd.1.asok 2026-02-17T19:08:27.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T19:08:27.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16378/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T19:08:27.630 INFO:tasks.workunit.client.0.trial067.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T19:08:27.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-17T19:08:27.961 INFO:tasks.workunit.client.0.trial067.stderr:noup is unset 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:08:27.976 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:27.977 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:27.977 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:08:27.977 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:27.977 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:08:28.194 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 44 up_thru 48 down_at 43 last_clean_interval [36,41) [v2:127.0.0.1:6800/2079657828,v1:127.0.0.1:6801/2079657828] [v2:127.0.0.1:6802/2079657828,v1:127.0.0.1:6803/2079657828] exists,up 561792a7-31f4-4230-b33b-f7e7da1f979c 2026-02-17T19:08:28.195 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:08:28.195 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:28.196 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:28.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:08:28.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:28.197 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:08:28.414 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 54 up_thru 54 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/71694750,v1:127.0.0.1:6819/71694750] [v2:127.0.0.1:6820/71694750,v1:127.0.0.1:6821/71694750] exists,up f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:08:28.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:28.416 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:08:28.417 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:28.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:28.417 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:08:28.634 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 48 up_thru 0 down_at 47 last_clean_interval [38,41) [v2:127.0.0.1:6810/450463243,v1:127.0.0.1:6811/450463243] [v2:127.0.0.1:6812/450463243,v1:127.0.0.1:6813/450463243] exists,up 4dbf484c-66f7-4174-8ed1-5edd567d6ace 2026-02-17T19:08:28.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:08:28.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:08:28.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:08:28.634 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:28.843 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:28.844 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 52:149 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:28.844 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:28.844 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:28.844 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:28.852 INFO:tasks.workunit.client.0.trial067.stdout:wait for peering 2026-02-17T19:08:28.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-17T19:08:28.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:29.075 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:29.075 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 52:149 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:29.075 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:29.075 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:29.075 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:29.083 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.ayotjyc1YF 2026-02-17T19:08:29.113 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.ayotjyc1YF 2026-02-17T19:08:29.115 INFO:tasks.workunit.client.0.trial067.stdout:killing divergent 1 2026-02-17T19:08:29.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-17T19:08:29.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:29.325 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:29.326 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T19:07:47.409109+0000 41'102 52:149 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:56:14.905171+0000 0 0 2026-02-17T19:08:29.326 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:29.326 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:29.326 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:29.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T19:08:29.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:08:29.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:08:29.335 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:08:29.336 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:08:29.336 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:08:29.443 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:08:29.444 INFO:tasks.workunit.client.0.trial067.stdout:reviving divergent 1 2026-02-17T19:08:29.444 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-17T19:08:29.444 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:29.644 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:29.644 INFO:tasks.workunit.client.0.trial067.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-17T19:08:27.954851+0000 29'104 54:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T19:08:29.644 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:29.644 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:29.645 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:29.655 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:08:29.656 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:08:29.657 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:08:29.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T19:08:29.659 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=84f14964-cea1-4e56-9433-4d1b03bf4049 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16378/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:08:29.660 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:08:29.683 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:29.674+0000 7fb3bb2b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:29.684 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:29.674+0000 7fb3bb2b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:29.685 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:29.674+0000 7fb3bb2b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:29.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T19:08:29.877 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:08:29.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:08:29.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:08:29.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:08:29.878 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:29.879 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:29.880 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:08:29.880 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:29.880 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:08:30.056 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:30.046+0000 7fb3bb2b7a40 -1 Falling back to public interface 2026-02-17T19:08:30.096 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 54 up_thru 54 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/71694750,v1:127.0.0.1:6819/71694750] [v2:127.0.0.1:6820/71694750,v1:127.0.0.1:6821/71694750] exists,up f7a394e4-d8a0-468e-b55e-1236bf3b4d00 2026-02-17T19:08:30.096 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:08:30.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:08:30.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:08:30.097 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-17T19:08:30.632 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:30.622+0000 7fb3bb2b7a40 -1 osd.1 55 log_to_monitors true 2026-02-17T19:08:50.097 INFO:tasks.workunit.client.0.trial067.stdout:allowing recovery 2026-02-17T19:08:50.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-17T19:08:50.098 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:50.298 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:50.298 INFO:tasks.workunit.client.0.trial067.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T19:08:30.990718+0000 55'103 59:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-19T00:06:34.725302+0000 0 0 2026-02-17T19:08:50.299 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:50.299 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:50.299 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:50.307 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T19:08:50.307 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T19:08:50.391 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:08:50.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T19:08:50.398 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T19:08:50.481 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:08:50.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T19:08:50.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T19:08:50.564 INFO:tasks.workunit.client.0.trial067.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T19:08:50.573 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-17T19:08:50.573 INFO:tasks.workunit.client.0.trial067.stdout:reading divergent objects 2026-02-17T19:08:50.574 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T19:08:50.774 INFO:tasks.workunit.client.0.trial067.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T19:08:50.775 INFO:tasks.workunit.client.0.trial067.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T19:08:30.990718+0000 55'103 59:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T19:06:35.388504+0000 0'0 2026-02-17T19:06:35.388504+0000 0 0 periodic scrub scheduled @ 2026-02-19T00:06:34.725302+0000 0 0 2026-02-17T19:08:50.775 INFO:tasks.workunit.client.0.trial067.stdout: 2026-02-17T19:08:50.775 INFO:tasks.workunit.client.0.trial067.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T19:08:50.775 INFO:tasks.workunit.client.0.trial067.stderr:dumped pgs 2026-02-17T19:08:50.784 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-17T19:08:50.785 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-17T19:08:50.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:08:50.786 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T19:08:50.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:08:50.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T19:08:50.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:08:50.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T19:08:50.862 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T19:08:50.862 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T19:08:50.891 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-17T19:08:50.892 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T19:08:50.894 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T19:06:48.853573+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T19:06:48.853573+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-17T19:06:53.797418+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-17T19:06:53.797418+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:08:50.897 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-17T19:06:53.797418+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-17T19:08:50.898 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-17T19:06:52.690827+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4559.0:1 2026-02-17T19:06:53.686568+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-17T19:06:52.690827+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4559.0:1 2026-02-17T19:06:53.686568+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4559.0:1 2026-02-17T19:06:53.686568+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T19:08:50.899 INFO:tasks.workunit.client.0.trial067.stdout:td/divergent-priors/osd.1.log:2026-02-17T19:08:28.366+0000 7f4ca3b3c640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T19:08:50.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T19:08:50.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T19:08:50.904 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-17T19:08:50.904 INFO:tasks.workunit.client.0.trial067.stdout:success 2026-02-17T19:08:50.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-17T19:08:50.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T19:08:50.905 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T19:08:51.169 INFO:tasks.workunit.client.0.trial067.stderr:pool 'test' does not exist 2026-02-17T19:08:51.178 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-17T19:08:51.179 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:08:51.180 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:08:51.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:08:51.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:08:51.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:08:56.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:08:56.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T19:08:56.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:08:56.496 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:08:56.497 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:08:56.497 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:08:56.497 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:08:56.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:08:56.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:08:56.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:08:56.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:08:56.504 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:08:56.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:08:56.505 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:08:56.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:08:56.507 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:08:56.507 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:08:56.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.508 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:08:56.509 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:08:56.509 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.510 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:08:56.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:08:56.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:08:56.533 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:08:56.533 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.533 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:56.533 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:08:56.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:08:56.534 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:08:56.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T19:08:56.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-17T19:08:56.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T19:08:56.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T19:08:56.535 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T19:08:56.536 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:08:56.536 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:08:56.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:08:56.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:08:56.536 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:08:56.537 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:08:56.538 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:08:56.539 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:08:56.539 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:08:56.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:08:56.541 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:08:56.541 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:08:56.542 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:08:56.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:08:56.543 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.544 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:08:56.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T19:08:56.545 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T19:08:56.547 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:08:56.547 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.547 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16378 2026-02-17T19:08:56.547 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16378 2026-02-17T19:08:56.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:08:56.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:08:56.548 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T19:08:56.549 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T19:08:56.550 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T19:08:56.559 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-17T19:08:56.560 DEBUG:teuthology.orchestra.run.trial067:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-17T19:08:56.611 INFO:tasks.workunit.client.0.trial067.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T19:08:56.614 INFO:tasks.workunit.client.0.trial067.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-17T19:08:56.615 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-17T19:08:56.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-17T19:08:56.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-17T19:08:56.616 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-17T19:08:56.616 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none ' 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-17T19:08:56.617 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-17T19:08:56.618 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-17T19:08:56.618 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-17T19:08:56.618 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T19:08:56.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-17T19:08:56.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-17T19:08:56.619 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:08:56.620 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:08:56.621 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:08:56.621 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:08:56.622 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:08:56.622 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:08:56.624 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:08:56.624 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:08:56.624 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:08:56.625 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.625 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:08:56.626 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:08:56.626 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:08:56.627 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:08:56.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:08:56.628 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T19:08:56.630 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:08:56.630 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.630 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.630 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72089 2026-02-17T19:08:56.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:08:56.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:08:56.631 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-17T19:08:56.633 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:08:56.633 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.633 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.633 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72089 2026-02-17T19:08:56.634 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-17T19:08:56.636 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.637 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:08:56.637 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:08:56.637 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:08:56.637 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-17T19:08:56.637 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.657 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:08:56.658 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:08:56.685 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:08:56.686 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:08:56.686 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:08:56.687 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72089/ceph-mon.a.asok 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:08:56.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72089/ceph-mon.a.asok config get fsid 2026-02-17T19:08:56.743 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:08:56.743 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.744 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.745 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72089/ceph-mon.a.asok 2026-02-17T19:08:56.745 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:08:56.745 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72089/ceph-mon.a.asok config get mon_host 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:08:56.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-17T19:08:56.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:08:56.914 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:08:56.914 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:08:56.936 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-17T19:08:56.936 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T19:08:56.936 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:08:56.936 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:08:56.936 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:08:56.937 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:08:56.938 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T19:08:56.939 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:08:56.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d5d1211b-69a1-4b0e-a247-d95f74eabcd9 2026-02-17T19:08:56.940 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d5d1211b-69a1-4b0e-a247-d95f74eabcd9' 2026-02-17T19:08:56.940 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 d5d1211b-69a1-4b0e-a247-d95f74eabcd9 2026-02-17T19:08:56.941 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:08:56.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDIvJRpuoj+NxAA5xPkegUtCsTtnXvcG3uzCg== 2026-02-17T19:08:56.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDIvJRpuoj+NxAA5xPkegUtCsTtnXvcG3uzCg=="}' 2026-02-17T19:08:56.948 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d5d1211b-69a1-4b0e-a247-d95f74eabcd9 -i td/ec-error-rollforward/0/new.json 2026-02-17T19:08:57.059 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:57.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-17T19:08:57.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDIvJRpuoj+NxAA5xPkegUtCsTtnXvcG3uzCg== --osd-uuid d5d1211b-69a1-4b0e-a247-d95f74eabcd9 2026-02-17T19:08:57.084 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.071+0000 7f8a8c0eda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:57.086 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.071+0000 7f8a8c0eda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:57.087 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.075+0000 7f8a8c0eda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:57.087 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.075+0000 7f8a8c0eda40 -1 bdev(0x5642680a4400 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:08:57.088 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.075+0000 7f8a8c0eda40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-17T19:08:57.838 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-17T19:08:57.838 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:08:57.839 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:08:57.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:08:57.839 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:08:57.959 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:08:57.960 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:08:57.960 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:08:57.960 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:08:57.961 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:08:57.961 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:08:57.981 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.967+0000 7f3aa2f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:57.983 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.971+0000 7f3aa2f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:57.984 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:57.971+0000 7f3aa2f93a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:08:58.067 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:58.068 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:08:58.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:08:58.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:58.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:08:58.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:08:58.532 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:58.519+0000 7f3aa2f93a40 -1 Falling back to public interface 2026-02-17T19:08:59.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:08:59.174 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:08:59.174 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:08:59.174 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:08:59.175 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:08:59.175 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:08:59.278 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:08:59.492 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:08:59.479+0000 7f3aa2f93a40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:09:00.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:00.279 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:00.280 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:00.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:00.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:00.281 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:00.495 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/724939273,v1:127.0.0.1:6801/724939273] [v2:127.0.0.1:6802/724939273,v1:127.0.0.1:6803/724939273] exists,up d5d1211b-69a1-4b0e-a247-d95f74eabcd9 2026-02-17T19:09:00.497 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:00.497 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:00.497 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:00.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:00.499 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T19:09:00.500 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:00.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ed186665-0b8b-4467-a117-6ddc3ad01597 2026-02-17T19:09:00.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ed186665-0b8b-4467-a117-6ddc3ad01597' 2026-02-17T19:09:00.502 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 ed186665-0b8b-4467-a117-6ddc3ad01597 2026-02-17T19:09:00.502 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:00.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDMvJRpLG7tHRAA1zPlBVyUISH3XdZQ6NqMBA== 2026-02-17T19:09:00.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDMvJRpLG7tHRAA1zPlBVyUISH3XdZQ6NqMBA=="}' 2026-02-17T19:09:00.511 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ed186665-0b8b-4467-a117-6ddc3ad01597 -i td/ec-error-rollforward/1/new.json 2026-02-17T19:09:00.719 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:00.728 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-17T19:09:00.729 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDMvJRpLG7tHRAA1zPlBVyUISH3XdZQ6NqMBA== --osd-uuid ed186665-0b8b-4467-a117-6ddc3ad01597 2026-02-17T19:09:00.744 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:00.731+0000 7f1b84957a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:00.745 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:00.731+0000 7f1b84957a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:00.746 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:00.735+0000 7f1b84957a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:00.747 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:00.735+0000 7f1b84957a40 -1 bdev(0x564ad5d5e400 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:00.747 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:00.735+0000 7f1b84957a40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-17T19:09:01.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-17T19:09:01.413 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:01.414 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:09:01.414 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:09:01.415 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:01.716 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:09:01.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:09:01.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:01.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:01.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:01.717 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:01.731 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:01.719+0000 7f15ff835a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:01.733 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:01.719+0000 7f15ff835a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:01.733 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:01.719+0000 7f15ff835a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:01.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:01.932 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:01.933 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:01.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:01.933 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:02.124 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:02.111+0000 7f15ff835a40 -1 Falling back to public interface 2026-02-17T19:09:02.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:02.696 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:02.683+0000 7f15ff835a40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:03.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:03.358 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3332539136,v1:127.0.0.1:6811/3332539136] [v2:127.0.0.1:6812/3332539136,v1:127.0.0.1:6813/3332539136] exists,up ed186665-0b8b-4467-a117-6ddc3ad01597 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:03.361 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:03.362 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:03.363 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:03.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:03.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:03.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:03.364 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T19:09:03.364 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:03.365 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=01a11d73-b382-4bb8-9549-02ce2c846b52 2026-02-17T19:09:03.365 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 01a11d73-b382-4bb8-9549-02ce2c846b52 2026-02-17T19:09:03.365 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 01a11d73-b382-4bb8-9549-02ce2c846b52' 2026-02-17T19:09:03.365 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:03.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDPvJRp4cjeFRAAMrRQnTsCdtVClYLmpa00uA== 2026-02-17T19:09:03.375 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDPvJRp4cjeFRAAMrRQnTsCdtVClYLmpa00uA=="}' 2026-02-17T19:09:03.376 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 01a11d73-b382-4bb8-9549-02ce2c846b52 -i td/ec-error-rollforward/2/new.json 2026-02-17T19:09:03.594 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:03.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-17T19:09:03.603 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDPvJRp4cjeFRAAMrRQnTsCdtVClYLmpa00uA== --osd-uuid 01a11d73-b382-4bb8-9549-02ce2c846b52 2026-02-17T19:09:03.619 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:03.607+0000 7f10f4dcaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:03.620 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:03.607+0000 7f10f4dcaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:03.621 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:03.607+0000 7f10f4dcaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:03.621 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:03.607+0000 7f10f4dcaa40 -1 bdev(0x55ee1cc54400 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:03.622 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:03.607+0000 7f10f4dcaa40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-17T19:09:04.317 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-17T19:09:04.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:04.318 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:09:04.318 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:09:04.319 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:04.606 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:09:04.607 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:09:04.607 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:04.607 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:04.607 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:04.607 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:04.627 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:04.615+0000 7fe73ee3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:04.629 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:04.615+0000 7fe73ee3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:04.630 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:04.615+0000 7fe73ee3fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:04.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:09:04.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:04.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:09:04.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:04.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:04.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:04.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:04.823 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:04.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:04.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:05.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:05.084 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:05.071+0000 7fe73ee3fa40 -1 Falling back to public interface 2026-02-17T19:09:05.696 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:05.683+0000 7fe73ee3fa40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:09:06.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:06.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:06.029 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:06.029 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:06.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:06.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:06.243 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:07.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:07.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:07.245 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:07.245 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:07.246 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:07.246 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:07.454 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1391511680,v1:127.0.0.1:6819/1391511680] [v2:127.0.0.1:6820/1391511680,v1:127.0.0.1:6821/1391511680] exists,up 01a11d73-b382-4bb8-9549-02ce2c846b52 2026-02-17T19:09:07.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:07.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:07.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T19:09:07.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:07.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7856e73b-1b41-4e26-8a4a-65e05aada819 2026-02-17T19:09:07.458 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7856e73b-1b41-4e26-8a4a-65e05aada819' 2026-02-17T19:09:07.458 INFO:tasks.workunit.client.0.trial067.stdout:add osd3 7856e73b-1b41-4e26-8a4a-65e05aada819 2026-02-17T19:09:07.459 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:07.470 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDTvJRpe86CGxAACa1WvZ1KdKliOwfDSEZsHA== 2026-02-17T19:09:07.470 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDTvJRpe86CGxAACa1WvZ1KdKliOwfDSEZsHA=="}' 2026-02-17T19:09:07.470 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7856e73b-1b41-4e26-8a4a-65e05aada819 -i td/ec-error-rollforward/3/new.json 2026-02-17T19:09:07.681 INFO:tasks.workunit.client.0.trial067.stdout:3 2026-02-17T19:09:07.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-17T19:09:07.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTvJRpe86CGxAACa1WvZ1KdKliOwfDSEZsHA== --osd-uuid 7856e73b-1b41-4e26-8a4a-65e05aada819 2026-02-17T19:09:07.707 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:07.695+0000 7ffb3f282a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:07.708 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:07.695+0000 7ffb3f282a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:07.709 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:07.695+0000 7ffb3f282a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:07.710 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:07.695+0000 7ffb3f282a40 -1 bdev(0x55ae98f06400 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:07.710 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:07.695+0000 7ffb3f282a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-17T19:09:08.353 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-17T19:09:08.353 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:08.354 INFO:tasks.workunit.client.0.trial067.stdout:adding osd3 key to auth repository 2026-02-17T19:09:08.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T19:09:08.355 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:08.639 INFO:tasks.workunit.client.0.trial067.stdout:start osd.3 2026-02-17T19:09:08.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T19:09:08.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:08.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:08.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:08.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:08.661 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:08.647+0000 7efc584f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:08.663 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:08.651+0000 7efc584f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:08.664 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:08.651+0000 7efc584f7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:08.856 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T19:09:08.856 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:08.856 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T19:09:08.857 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:08.857 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:08.857 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:08.857 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:08.857 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:08.858 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:08.858 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:09.036 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:09.023+0000 7efc584f7a40 -1 Falling back to public interface 2026-02-17T19:09:09.068 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:09.697 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:09.683+0000 7efc584f7a40 -1 osd.3 0 log_to_monitors true 2026-02-17T19:09:10.069 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:10.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:10.070 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:10.071 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:10.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:10.072 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:10.280 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:11.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:11.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:11.282 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:11.282 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:11.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:11.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:11.490 INFO:tasks.workunit.client.0.trial067.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/893695326,v1:127.0.0.1:6827/893695326] [v2:127.0.0.1:6828/893695326,v1:127.0.0.1:6829/893695326] exists,up 7856e73b-1b41-4e26-8a4a-65e05aada819 2026-02-17T19:09:11.490 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:11.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:11.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:11.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-17T19:09:11.749 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-17T19:09:12.117 INFO:tasks.workunit.client.0.trial067.stderr:pool 'ec' already exists 2026-02-17T19:09:12.126 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-17T19:09:12.829 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-17T19:09:12.830 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 76679 2026-02-17T19:09:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=79152 2026-02-17T19:09:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-17T19:09:12.831 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-17T19:09:13.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 79173' 2026-02-17T19:09:13.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-17T19:09:13.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 79174' 2026-02-17T19:09:13.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-17T19:09:13.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 79175' 2026-02-17T19:09:13.834 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-17T19:09:13.834 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-17T19:09:14.834 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-17T19:09:14.836 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:14.836 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:14.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:14.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:14.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:14.946 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:14.946 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 79152 79173 79174 79175 2026-02-17T19:09:14.947 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T19:09:14.950 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:14.951 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:09:14.952 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:09:14.953 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T19:09:14.953 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:09:14.954 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:09:14.955 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:09:14.967 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:14.955+0000 7f84f2ba1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:14.968 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:14.955+0000 7f84f2ba1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:14.969 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:14.955+0000 7f84f2ba1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T19:09:15.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:15.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:09:15.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:15.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:15.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:15.172 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:15.172 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:15.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:15.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:15.308 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.295+0000 7f84f2ba1a40 -1 Falling back to public interface 2026-02-17T19:09:15.382 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/724939273,v1:127.0.0.1:6801/724939273] [v2:127.0.0.1:6802/724939273,v1:127.0.0.1:6803/724939273] exists,up d5d1211b-69a1-4b0e-a247-d95f74eabcd9 2026-02-17T19:09:15.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:15.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:15.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:15.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-17T19:09:15.385 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:15.386 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:15.387 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T19:09:15.388 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:09:15.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T19:09:15.389 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:15.389 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-17T19:09:15.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T19:09:15.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:09:15.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:09:15.390 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:09:15.402 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.387+0000 7ff3d352aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.403 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.391+0000 7ff3d352aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.405 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.391+0000 7ff3d352aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:15.599 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:15.600 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:15.600 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:15.600 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:15.600 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:15.818 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 9 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3332539136,v1:127.0.0.1:6811/3332539136] [v2:127.0.0.1:6812/3332539136,v1:127.0.0.1:6813/3332539136] exists,up ed186665-0b8b-4467-a117-6ddc3ad01597 2026-02-17T19:09:15.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:15.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:15.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:15.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-17T19:09:15.822 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:15.823 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:15.824 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T19:09:15.825 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:09:15.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T19:09:15.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:15.827 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-17T19:09:15.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T19:09:15.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:09:15.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:09:15.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:09:15.842 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.831+0000 7fa0ec3e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.844 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.831+0000 7fa0ec3e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.845 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.831+0000 7fa0ec3e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:15.864 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:15.851+0000 7ff3d352aa40 -1 Falling back to public interface 2026-02-17T19:09:16.039 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T19:09:16.039 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:16.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:09:16.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:16.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:16.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:16.040 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:16.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:16.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:16.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:16.257 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1391511680,v1:127.0.0.1:6819/1391511680] [v2:127.0.0.1:6820/1391511680,v1:127.0.0.1:6821/1391511680] exists,up 01a11d73-b382-4bb8-9549-02ce2c846b52 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T19:09:16.261 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:16.262 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T19:09:16.263 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T19:09:16.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T19:09:16.264 INFO:tasks.workunit.client.0.trial067.stdout:start osd.3 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=7cf81471-9651-4c14-9abc-4e624846d528 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72089/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T19:09:16.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T19:09:16.282 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.267+0000 7fb2f29d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:16.284 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.271+0000 7fb2f29d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:16.285 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.271+0000 7fb2f29d5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:16.306 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.291+0000 7f84f2ba1a40 -1 osd.0 22 log_to_monitors true 2026-02-17T19:09:16.347 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.335+0000 7fa0ec3e9a40 -1 Falling back to public interface 2026-02-17T19:09:16.549 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T19:09:16.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:16.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T19:09:16.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:16.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:16.550 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:16.551 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:16.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:16.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:16.551 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:16.760 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.747+0000 7fb2f29d5a40 -1 Falling back to public interface 2026-02-17T19:09:16.825 INFO:tasks.workunit.client.0.trial067.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/893695326,v1:127.0.0.1:6827/893695326] [v2:127.0.0.1:6828/893695326,v1:127.0.0.1:6829/893695326] exists,up 7856e73b-1b41-4e26-8a4a-65e05aada819 2026-02-17T19:09:16.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:16.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T19:09:16.827 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T19:09:16.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T19:09:16.828 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T19:09:16.834 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:16.823+0000 7ff3d352aa40 -1 osd.1 22 log_to_monitors true 2026-02-17T19:09:16.920 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T19:09:16.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T19:09:16.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T19:09:16.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T19:09:16.921 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T19:09:16.921 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T19:09:17.140 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T19:09:17.140 INFO:tasks.workunit.client.0.trial067.stderr:1 2026-02-17T19:09:17.140 INFO:tasks.workunit.client.0.trial067.stderr:2 2026-02-17T19:09:17.141 INFO:tasks.workunit.client.0.trial067.stderr:3' 2026-02-17T19:09:17.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T19:09:17.141 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:09:17.141 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T19:09:17.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-17T19:09:17.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-17T19:09:17.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403' 2026-02-17T19:09:17.219 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:09:17.219 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T19:09:17.298 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149699 2026-02-17T19:09:17.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149699 2026-02-17T19:09:17.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403 1-111669149699' 2026-02-17T19:09:17.299 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:09:17.299 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T19:09:17.365 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:17.351+0000 7fa0ec3e9a40 -1 osd.2 21 log_to_monitors true 2026-02-17T19:09:17.706 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:17.695+0000 7fb2f29d5a40 -1 osd.3 22 log_to_monitors true 2026-02-17T19:09:22.382 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018883 2026-02-17T19:09:22.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018883 2026-02-17T19:09:22.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403 1-111669149699 2-128849018883' 2026-02-17T19:09:22.383 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T19:09:22.383 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T19:09:22.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-17T19:09:22.462 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-17T19:09:22.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403 1-111669149699 2-128849018883 3-146028888067' 2026-02-17T19:09:22.463 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:09:22.463 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-107374182403 2026-02-17T19:09:22.463 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:09:22.464 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T19:09:22.465 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-107374182403 2026-02-17T19:09:22.465 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:09:22.467 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182403 2026-02-17T19:09:22.467 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 107374182403' 2026-02-17T19:09:22.467 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.0 seq 107374182403 2026-02-17T19:09:22.467 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T19:09:22.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-17T19:09:22.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:09:22.676 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-111669149699 2026-02-17T19:09:22.676 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:09:22.677 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T19:09:22.678 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-111669149699 2026-02-17T19:09:22.678 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:09:22.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149699 2026-02-17T19:09:22.679 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 111669149699' 2026-02-17T19:09:22.680 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.1 seq 111669149699 2026-02-17T19:09:22.680 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T19:09:22.897 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149699 -lt 111669149699 2026-02-17T19:09:22.897 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:09:22.898 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-128849018883 2026-02-17T19:09:22.898 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:09:22.899 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T19:09:22.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-128849018883 2026-02-17T19:09:22.900 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:09:22.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018883 2026-02-17T19:09:22.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 128849018883' 2026-02-17T19:09:22.902 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.2 seq 128849018883 2026-02-17T19:09:22.902 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:09:23.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 128849018883 2026-02-17T19:09:23.118 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T19:09:24.119 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T19:09:24.120 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T19:09:24.332 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018883 2026-02-17T19:09:24.333 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T19:09:24.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-146028888067 2026-02-17T19:09:24.333 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T19:09:24.334 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T19:09:24.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-146028888067 2026-02-17T19:09:24.335 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T19:09:24.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-17T19:09:24.337 INFO:tasks.workunit.client.0.trial067.stdout:waiting osd.3 seq 146028888067 2026-02-17T19:09:24.337 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 146028888067' 2026-02-17T19:09:24.338 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T19:09:24.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888068 -lt 146028888067 2026-02-17T19:09:24.560 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T19:09:24.560 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:09:24.561 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T19:09:24.840 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T19:09:24.841 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T19:09:25.047 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T19:09:25.048 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T19:09:25.049 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T19:09:25.049 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T19:09:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T19:09:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T19:09:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T19:09:25.330 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:25.331 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:25.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:25.641 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:25.642 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:25.643 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:25.644 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:25.644 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:25.645 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:25.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.646 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:25.647 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:25.647 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.648 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:25.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:09:25.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T19:09:25.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:25.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.662 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:25.662 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72089 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:25.665 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:25.666 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:25.666 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:25.667 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:25.667 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:25.667 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:25.668 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:25.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:25.669 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:25.669 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:25.670 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.670 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:25.671 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:25.671 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.672 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:25.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T19:09:25.673 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T19:09:25.674 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:25.674 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.674 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72089 2026-02-17T19:09:25.674 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72089 2026-02-17T19:09:25.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:25.675 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:25.676 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T19:09:25.677 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T19:09:25.677 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T19:09:25.730 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-17T19:09:25.731 DEBUG:teuthology.orchestra.run.trial067:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-17T19:09:25.784 INFO:tasks.workunit.client.0.trial067.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T19:09:25.787 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-17T19:09:25.788 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-17T19:09:25.789 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=b839ba12-43dd-4094-9004-ee7599c3aab1 --auth-supported=none ' 2026-02-17T19:09:25.789 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-17T19:09:25.789 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-17T19:09:25.789 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-17T19:09:25.789 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T19:09:25.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-17T19:09:25.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-17T19:09:25.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-17T19:09:25.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-17T19:09:25.791 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:25.792 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:25.793 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:25.793 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:25.794 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:25.794 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:25.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:25.795 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:25.796 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:25.797 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.797 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:25.797 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:25.797 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:25.798 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:25.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:09:25.800 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T19:09:25.801 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:25.801 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.801 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:25.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81793 2026-02-17T19:09:25.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:25.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:25.803 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-17T19:09:25.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:09:25.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.804 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:25.805 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.81793 2026-02-17T19:09:25.806 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:09:25.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T19:09:25.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T19:09:25.807 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-17T19:09:25.808 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-17T19:09:25.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:09:25.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:25.831 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:25.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:25.831 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.832 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:25.832 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81793/$cluster-$name.asok' 2026-02-17T19:09:25.832 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.81793/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:09:25.855 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:09:25.856 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:09:25.856 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:09:25.857 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:09:25.857 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:09:25.857 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:25.858 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.81793/ceph-mon.a.asok 2026-02-17T19:09:25.859 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:09:25.859 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.81793/ceph-mon.a.asok config get fsid 2026-02-17T19:09:25.912 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:09:25.913 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.81793/ceph-mon.a.asok 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:09:25.914 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.81793/ceph-mon.a.asok config get mon_host 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-17T19:09:25.968 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:09:26.082 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:09:26.083 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:26.083 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:26.083 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:26.083 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:26.083 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:26.084 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81793/$cluster-$name.asok' 2026-02-17T19:09:26.084 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:09:26.085 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.81793/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:26.102 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b839ba12-43dd-4094-9004-ee7599c3aab1 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:26.103 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81793/$cluster-$name.asok' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.81793/$cluster-$name.asok' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:26.104 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:26.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:26.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:26.105 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-17T19:09:26.105 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:26.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eb797860-ad40-4655-8c4d-5696ea8efaba 2026-02-17T19:09:26.106 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 eb797860-ad40-4655-8c4d-5696ea8efaba' 2026-02-17T19:09:26.106 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 eb797860-ad40-4655-8c4d-5696ea8efaba 2026-02-17T19:09:26.106 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:26.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDmvJRpVIhbBhAABozRoDj99zETHpTiETUhhw== 2026-02-17T19:09:26.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDmvJRpVIhbBhAABozRoDj99zETHpTiETUhhw=="}' 2026-02-17T19:09:26.115 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eb797860-ad40-4655-8c4d-5696ea8efaba -i td/osd-bench/0/new.json 2026-02-17T19:09:26.228 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:26.236 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-17T19:09:26.237 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b839ba12-43dd-4094-9004-ee7599c3aab1 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.81793/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDmvJRpVIhbBhAABozRoDj99zETHpTiETUhhw== --osd-uuid eb797860-ad40-4655-8c4d-5696ea8efaba 2026-02-17T19:09:26.252 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:26.239+0000 7f6169e9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:26.255 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:26.243+0000 7f6169e9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:26.256 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:26.243+0000 7f6169e9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:26.257 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:26.243+0000 7f6169e9da40 -1 bdev(0x55e176086400 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:26.257 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:26.243+0000 7f6169e9da40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-17T19:09:27.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-17T19:09:27.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:27.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:09:27.035 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:09:27.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:27.155 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:09:27.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:09:27.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b839ba12-43dd-4094-9004-ee7599c3aab1 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.81793/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:27.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:27.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:27.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:27.179 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:27.167+0000 7f92a680ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:27.181 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:27.167+0000 7f92a680ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:27.182 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:27.167+0000 7f92a680ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:27.264 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:27.265 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:27.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:27.265 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:27.370 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:27.568 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:27.555+0000 7f92a680ba40 -1 Falling back to public interface 2026-02-17T19:09:28.314 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:28.299+0000 7f92a680ba40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:09:28.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:28.372 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:28.373 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:28.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:28.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:28.373 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:28.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:29.477 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:29.477 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:29.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:29.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:29.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:29.478 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:29.685 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1508768298,v1:127.0.0.1:6801/1508768298] [v2:127.0.0.1:6802/1508768298,v1:127.0.0.1:6803/1508768298] exists,up eb797860-ad40-4655-8c4d-5696ea8efaba 2026-02-17T19:09:29.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:29.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:29.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:29.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-17T19:09:29.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-17T19:09:29.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-17T19:09:29.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-17T19:09:29.696 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-17T19:09:29.709 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-17T19:09:29.709 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-17T19:09:29.710 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-17T19:09:29.720 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-17T19:09:29.720 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-17T19:09:29.720 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-17T19:09:29.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-17T19:09:29.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-17T19:09:29.734 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T19:09:29.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T19:09:29.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-17T19:09:29.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T19:09:29.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T19:09:29.735 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-17T19:09:29.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T19:09:29.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T19:09:29.833 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T19:09:29.835 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T19:09:29.836 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-17T19:09:29.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T19:09:29.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T19:09:29.898 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-17T19:09:29.900 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T19:09:29.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T19:09:29.901 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-17T19:09:29.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T19:09:29.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T19:09:29.974 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-17T19:09:29.975 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T19:09:29.975 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-17T19:09:31.706 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_written": 1073741824, 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout: "blocksize": 4194304, 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout: "elapsed_sec": 0.75667563500000001, 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_per_sec": 1419025239.2625275, 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout: "iops": 338.32198125422656 2026-02-17T19:09:31.707 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:09:31.720 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-17T19:09:31.791 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:09:31.791 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_written": 10, 2026-02-17T19:09:31.791 INFO:tasks.workunit.client.0.trial067.stdout: "blocksize": 14456, 2026-02-17T19:09:31.791 INFO:tasks.workunit.client.0.trial067.stdout: "elapsed_sec": 0.00029545500000000002, 2026-02-17T19:09:31.792 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_per_sec": 33846.101775228039, 2026-02-17T19:09:31.792 INFO:tasks.workunit.client.0.trial067.stdout: "iops": 2.3413186064767597 2026-02-17T19:09:31.792 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:09:31.799 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-17T19:09:31.873 INFO:tasks.workunit.client.0.trial067.stdout:{ 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_written": 1, 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout: "blocksize": 14456, 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout: "elapsed_sec": 0.00020511499999999999, 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout: "bytes_per_sec": 4875.3138483289868, 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout: "iops": 0.33725192642010149 2026-02-17T19:09:31.874 INFO:tasks.workunit.client.0.trial067.stdout:} 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:31.884 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:31.992 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:31.992 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:31.993 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:31.993 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:31.994 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:31.994 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:31.994 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:31.995 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:31.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:31.996 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:31.996 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:31.997 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:31.998 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:09:31.998 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T19:09:32.031 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:32.031 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.031 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:32.031 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81793 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T19:09:32.033 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T19:09:32.034 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:32.034 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:32.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:32.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:32.034 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:32.035 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:32.035 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:32.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:32.036 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:32.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:32.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:32.038 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:32.039 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:32.039 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:32.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:32.040 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:32.041 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:32.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T19:09:32.042 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T19:09:32.043 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:32.043 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.044 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81793 2026-02-17T19:09:32.044 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81793 2026-02-17T19:09:32.044 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:32.045 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:32.045 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T19:09:32.046 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T19:09:32.046 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T19:09:32.098 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-17T19:09:32.099 DEBUG:teuthology.orchestra.run.trial067:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-17T19:09:32.151 INFO:tasks.workunit.client.0.trial067.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T19:09:32.156 INFO:tasks.workunit.client.0.trial067.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T19:09:32.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:09:32.156 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.157 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-17T19:09:32.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-17T19:09:32.158 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:TEST_bluestore2 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:TEST_bluestore_expand' 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T19:09:32.160 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:09:32.161 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:09:32.162 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:09:32.162 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:09:32.163 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:09:32.163 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:09:32.164 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:09:32.164 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:09:32.165 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:09:32.165 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:32.166 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:09:32.166 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:09:32.166 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:09:32.167 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:09:32.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T19:09:32.168 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T19:09:32.170 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:09:32.170 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.170 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.170 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83665 2026-02-17T19:09:32.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T19:09:32.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T19:09:32.171 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T19:09:32.173 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T19:09:32.173 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.173 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.173 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83665 2026-02-17T19:09:32.174 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T19:09:32.175 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.176 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-17T19:09:32.177 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none ' 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T19:09:32.179 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T19:09:32.180 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.202 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T19:09:32.202 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:32.202 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:32.202 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:32.203 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.203 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.203 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:32.203 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T19:09:32.228 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T19:09:32.229 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T19:09:32.229 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:09:32.230 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:09:32.230 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T19:09:32.230 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.231 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.232 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83665/ceph-mon.a.asok 2026-02-17T19:09:32.232 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:09:32.232 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83665/ceph-mon.a.asok config get fsid 2026-02-17T19:09:32.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T19:09:32.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T19:09:32.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T19:09:32.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T19:09:32.287 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T19:09:32.288 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T19:09:32.288 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83665/ceph-mon.a.asok 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T19:09:32.289 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83665/ceph-mon.a.asok config get mon_host 2026-02-17T19:09:32.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T19:09:32.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.343 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T19:09:32.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T19:09:32.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T19:09:32.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T19:09:32.344 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T19:09:32.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T19:09:32.457 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:32.458 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:09:32.459 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T19:09:32.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T19:09:32.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:32.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:32.479 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T19:09:32.480 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T19:09:32.481 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T19:09:32.482 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:32.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=36cbf3ca-30ca-4c9e-a9d6-d16b11356e45 2026-02-17T19:09:32.483 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 36cbf3ca-30ca-4c9e-a9d6-d16b11356e45' 2026-02-17T19:09:32.483 INFO:tasks.workunit.client.0.trial067.stdout:add osd0 36cbf3ca-30ca-4c9e-a9d6-d16b11356e45 2026-02-17T19:09:32.483 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:32.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDsvJRpjQHHHBAAn8i57SliHSYYh57aN4jCtA== 2026-02-17T19:09:32.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDsvJRpjQHHHBAAn8i57SliHSYYh57aN4jCtA=="}' 2026-02-17T19:09:32.491 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 36cbf3ca-30ca-4c9e-a9d6-d16b11356e45 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T19:09:32.601 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:32.609 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T19:09:32.610 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDsvJRpjQHHHBAAn8i57SliHSYYh57aN4jCtA== --osd-uuid 36cbf3ca-30ca-4c9e-a9d6-d16b11356e45 2026-02-17T19:09:32.627 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:32.615+0000 7fb89f85ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:32.628 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:32.615+0000 7fb89f85ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:32.629 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:32.615+0000 7fb89f85ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:32.630 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:32.615+0000 7fb89f85ba40 -1 bdev(0x564065a18400 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:32.630 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:32.615+0000 7fb89f85ba40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T19:09:34.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T19:09:34.706 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:34.707 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T19:09:34.708 INFO:tasks.workunit.client.0.trial067.stdout:adding osd0 key to auth repository 2026-02-17T19:09:34.708 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:34.824 INFO:tasks.workunit.client.0.trial067.stdout:start osd.0 2026-02-17T19:09:34.825 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T19:09:34.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:34.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:34.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:34.826 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:34.847 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:34.835+0000 7fbb80090a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:34.849 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:34.835+0000 7fbb80090a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:34.850 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:34.839+0000 7fbb80090a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:35.036 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:35.037 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:35.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:35.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:35.256 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:35.352 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:35.339+0000 7fbb80090a40 -1 Falling back to public interface 2026-02-17T19:09:36.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:36.257 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:36.258 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:36.258 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:36.258 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:36.259 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:36.472 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:36.498 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:36.483+0000 7fbb80090a40 -1 osd.0 0 log_to_monitors true 2026-02-17T19:09:37.473 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:37.473 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:37.474 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:37.474 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:37.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:37.475 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T19:09:37.686 INFO:tasks.workunit.client.0.trial067.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2551910413,v1:127.0.0.1:6803/2551910413] [v2:127.0.0.1:6804/2551910413,v1:127.0.0.1:6805/2551910413] exists,up 36cbf3ca-30ca-4c9e-a9d6-d16b11356e45 2026-02-17T19:09:37.686 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:37.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:37.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:37.687 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T19:09:37.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=85141 2026-02-17T19:09:37.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-17T19:09:37.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:37.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:37.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T19:09:37.691 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T19:09:37.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:37.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T19:09:37.694 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:37.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e26e7cf8-251d-4086-81d7-8a60f6a2f155 2026-02-17T19:09:37.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e26e7cf8-251d-4086-81d7-8a60f6a2f155' 2026-02-17T19:09:37.694 INFO:tasks.workunit.client.0.trial067.stdout:add osd1 e26e7cf8-251d-4086-81d7-8a60f6a2f155 2026-02-17T19:09:37.695 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:37.704 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDxvJRpj1Z8KRAA/zT+8hJJKvf6aeul1i7jDA== 2026-02-17T19:09:37.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDxvJRpj1Z8KRAA/zT+8hJJKvf6aeul1i7jDA=="}' 2026-02-17T19:09:37.705 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e26e7cf8-251d-4086-81d7-8a60f6a2f155 -i td/osd-bluefs-volume-ops/1/new.json 2026-02-17T19:09:37.920 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:37.930 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-17T19:09:37.931 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDxvJRpj1Z8KRAA/zT+8hJJKvf6aeul1i7jDA== --osd-uuid e26e7cf8-251d-4086-81d7-8a60f6a2f155 2026-02-17T19:09:37.946 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:37.935+0000 7f5d60815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:37.948 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:37.935+0000 7f5d60815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:37.948 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:37.935+0000 7f5d60815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:37.949 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:37.935+0000 7f5d60815a40 -1 bdev(0x561c9a53a400 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:37.949 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:37.935+0000 7f5d60815a40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-17T19:09:39.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-17T19:09:39.341 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:39.342 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T19:09:39.342 INFO:tasks.workunit.client.0.trial067.stdout:adding osd1 key to auth repository 2026-02-17T19:09:39.342 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:39.648 INFO:tasks.workunit.client.0.trial067.stdout:start osd.1 2026-02-17T19:09:39.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T19:09:39.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:39.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:39.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:39.649 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:39.664 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:39.651+0000 7f6d82c11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:39.665 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:39.651+0000 7f6d82c11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:39.666 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:39.655+0000 7f6d82c11a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:39.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T19:09:39.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:39.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T19:09:39.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:39.866 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:39.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:39.867 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:39.867 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:39.868 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:39.868 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:40.079 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:40.199 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:40.187+0000 7f6d82c11a40 -1 Falling back to public interface 2026-02-17T19:09:41.080 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:41.080 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:41.080 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:41.081 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:41.081 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:41.081 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:41.289 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:41.359 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:41.347+0000 7f6d82c11a40 -1 osd.1 0 log_to_monitors true 2026-02-17T19:09:42.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:42.290 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:42.291 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:42.291 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:42.291 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:42.292 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T19:09:42.498 INFO:tasks.workunit.client.0.trial067.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/290442995,v1:127.0.0.1:6811/290442995] [v2:127.0.0.1:6812/290442995,v1:127.0.0.1:6813/290442995] exists,up e26e7cf8-251d-4086-81d7-8a60f6a2f155 2026-02-17T19:09:42.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:42.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:42.498 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:42.499 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T19:09:42.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=87372 2026-02-17T19:09:42.500 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:42.501 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:42.502 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T19:09:42.502 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:42.502 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:42.502 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:42.503 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T19:09:42.504 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:42.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f684ac67-e445-42b0-92be-954ebbfb3caf 2026-02-17T19:09:42.505 INFO:tasks.workunit.client.0.trial067.stdout:add osd2 f684ac67-e445-42b0-92be-954ebbfb3caf 2026-02-17T19:09:42.505 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f684ac67-e445-42b0-92be-954ebbfb3caf' 2026-02-17T19:09:42.505 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:42.516 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD2vJRp33pKHhAARvlqbrz2LXdJ4hzDYmeehg== 2026-02-17T19:09:42.516 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD2vJRp33pKHhAARvlqbrz2LXdJ4hzDYmeehg=="}' 2026-02-17T19:09:42.516 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f684ac67-e445-42b0-92be-954ebbfb3caf -i td/osd-bluefs-volume-ops/2/new.json 2026-02-17T19:09:42.736 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:42.746 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-17T19:09:42.748 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD2vJRp33pKHhAARvlqbrz2LXdJ4hzDYmeehg== --osd-uuid f684ac67-e445-42b0-92be-954ebbfb3caf 2026-02-17T19:09:42.771 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:42.759+0000 7fe8c3547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:42.773 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:42.759+0000 7fe8c3547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:42.774 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:42.763+0000 7fe8c3547a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:42.775 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:42.763+0000 7fe8c3547a40 -1 bdev(0x5651957c8400 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:42.775 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:42.763+0000 7fe8c3547a40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-17T19:09:44.293 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-17T19:09:44.294 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:44.294 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T19:09:44.295 INFO:tasks.workunit.client.0.trial067.stdout:adding osd2 key to auth repository 2026-02-17T19:09:44.295 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:44.583 INFO:tasks.workunit.client.0.trial067.stdout:start osd.2 2026-02-17T19:09:44.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T19:09:44.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:44.584 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:44.585 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:44.585 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:44.599 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:44.587+0000 7fac6ded8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:44.601 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:44.587+0000 7fac6ded8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:44.602 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:44.591+0000 7fac6ded8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:44.801 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:44.802 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:44.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:44.802 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:45.017 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:45.148 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:45.135+0000 7fac6ded8a40 -1 Falling back to public interface 2026-02-17T19:09:46.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:46.019 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:46.019 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:46.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:46.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:46.020 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:46.229 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:46.333 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:46.319+0000 7fac6ded8a40 -1 osd.2 0 log_to_monitors true 2026-02-17T19:09:47.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:47.231 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:47.232 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:47.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:47.232 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:47.233 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T19:09:47.447 INFO:tasks.workunit.client.0.trial067.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2318800932,v1:127.0.0.1:6819/2318800932] [v2:127.0.0.1:6820/2318800932,v1:127.0.0.1:6821/2318800932] exists,up f684ac67-e445-42b0-92be-954ebbfb3caf 2026-02-17T19:09:47.448 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:47.448 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:47.449 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:47.449 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=89728 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T19:09:47.451 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T19:09:47.452 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T19:09:47.453 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T19:09:47.453 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:09:47.453 INFO:tasks.workunit.client.0.trial067.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:09:47.453 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:47.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' 2026-02-17T19:09:47.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T19:09:47.454 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T19:09:47.455 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3 2026-02-17T19:09:47.456 INFO:tasks.workunit.client.0.trial067.stdout:add osd3 b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3 2026-02-17T19:09:47.456 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3' 2026-02-17T19:09:47.456 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T19:09:47.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD7vJRpd2tCGxAA4Uw+pHXJTbl9uW/3u3jxkQ== 2026-02-17T19:09:47.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD7vJRpd2tCGxAA4Uw+pHXJTbl9uW/3u3jxkQ=="}' 2026-02-17T19:09:47.465 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-17T19:09:47.683 INFO:tasks.workunit.client.0.trial067.stdout:3 2026-02-17T19:09:47.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-17T19:09:47.693 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD7vJRpd2tCGxAA4Uw+pHXJTbl9uW/3u3jxkQ== --osd-uuid b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3 2026-02-17T19:09:47.708 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:47.695+0000 7fbee250aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:47.710 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:47.695+0000 7fbee250aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:47.711 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:47.699+0000 7fbee250aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:47.711 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:47.699+0000 7fbee250aa40 -1 bdev(0x56110a50e400 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-17T19:09:47.712 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:47.699+0000 7fbee250aa40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-17T19:09:49.133 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-17T19:09:49.133 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T19:09:49.134 INFO:tasks.workunit.client.0.trial067.stdout:adding osd3 key to auth repository 2026-02-17T19:09:49.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T19:09:49.134 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T19:09:49.425 INFO:tasks.workunit.client.0.trial067.stdout:start osd.3 2026-02-17T19:09:49.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T19:09:49.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c2d1dbe0-a41b-4936-b014-19ef11841ad9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83665/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T19:09:49.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T19:09:49.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T19:09:49.426 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T19:09:49.448 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:49.435+0000 7f1d07b3aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:49.450 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:49.435+0000 7f1d07b3aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:49.451 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:49.439+0000 7f1d07b3aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T19:09:49.638 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:49.639 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T19:09:49.640 INFO:tasks.workunit.client.0.trial067.stdout:0 2026-02-17T19:09:49.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:49.640 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:49.847 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:49.947 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:49.935+0000 7f1d07b3aa40 -1 Falling back to public interface 2026-02-17T19:09:50.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:50.849 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:50.849 INFO:tasks.workunit.client.0.trial067.stdout:1 2026-02-17T19:09:50.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T19:09:50.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:50.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:51.042 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:09:51.031+0000 7f1d07b3aa40 -1 osd.3 0 log_to_monitors true 2026-02-17T19:09:51.062 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T19:09:52.064 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T19:09:52.064 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T19:09:52.064 INFO:tasks.workunit.client.0.trial067.stdout:2 2026-02-17T19:09:52.065 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T19:09:52.065 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T19:09:52.065 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T19:09:52.283 INFO:tasks.workunit.client.0.trial067.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2714357237,v1:127.0.0.1:6827/2714357237] [v2:127.0.0.1:6828/2714357237,v1:127.0.0.1:6829/2714357237] exists,up b41151ce-bd9b-4ede-8ff4-a2bfc68aa6a3 2026-02-17T19:09:52.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T19:09:52.283 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T19:09:52.284 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T19:09:52.284 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T19:09:52.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=91911 2026-02-17T19:09:52.285 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-17T19:09:57.286 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-17T19:09:57.287 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-17T19:09:57.549 INFO:tasks.workunit.client.0.trial067.stderr:pool 'foo' already exists 2026-02-17T19:09:57.559 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T19:09:58.561 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T19:09:58.582 INFO:tasks.workunit.client.0.trial067.stdout:hints = 1 2026-02-17T19:09:58.582 INFO:tasks.workunit.client.0.trial067.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T19:09:58.582 INFO:tasks.workunit.client.0.trial067.stdout:Object prefix: benchmark_data_trial067_92923 2026-02-17T19:09:58.582 INFO:tasks.workunit.client.0.trial067.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T19:09:58.582 INFO:tasks.workunit.client.0.trial067.stdout: 0 0 0 0 0 0 - 0 2026-02-17T19:09:59.582 INFO:tasks.workunit.client.0.trial067.stdout: 1 16 10798 10782 42.114 42.1172 0.00103585 0.00148149 2026-02-17T19:10:00.582 INFO:tasks.workunit.client.0.trial067.stdout: 2 16 21696 21680 42.3405 42.5703 0.00178484 0.00147401 2026-02-17T19:10:01.582 INFO:tasks.workunit.client.0.trial067.stdout: 3 16 32772 32756 42.6477 43.2656 0.000948331 0.00146352 2026-02-17T19:10:02.582 INFO:tasks.workunit.client.0.trial067.stdout: 4 16 43844 43828 42.7974 43.25 0.00174009 0.0014587 2026-02-17T19:10:03.582 INFO:tasks.workunit.client.0.trial067.stdout: 5 16 54728 54712 42.7404 42.5156 0.0013785 0.00146066 2026-02-17T19:10:04.582 INFO:tasks.workunit.client.0.trial067.stdout: 6 16 65633 65617 42.716 42.5977 0.00212795 0.00146156 2026-02-17T19:10:05.582 INFO:tasks.workunit.client.0.trial067.stdout: 7 16 76462 76446 42.6562 42.3008 0.00185987 0.00146354 2026-02-17T19:10:06.582 INFO:tasks.workunit.client.0.trial067.stdout: 8 16 87512 87496 42.7193 43.1641 0.0017872 0.00146148 2026-02-17T19:10:07.582 INFO:tasks.workunit.client.0.trial067.stdout: 9 16 93454 93438 40.5514 23.2109 0.00129235 0.00153972 2026-02-17T19:10:08.582 INFO:tasks.workunit.client.0.trial067.stdout: 10 16 104437 104421 40.7862 42.9023 0.00487736 0.00153053 2026-02-17T19:10:09.582 INFO:tasks.workunit.client.0.trial067.stdout: 11 16 115177 115161 40.892 41.9531 0.00137924 0.0015269 2026-02-17T19:10:10.582 INFO:tasks.workunit.client.0.trial067.stdout: 12 16 126313 126297 41.109 43.5 0.00153771 0.00151882 2026-02-17T19:10:11.583 INFO:tasks.workunit.client.0.trial067.stdout: 13 16 136947 136931 41.1419 41.5391 0.00202981 0.00151761 2026-02-17T19:10:12.583 INFO:tasks.workunit.client.0.trial067.stdout: 14 16 144080 144064 40.1932 27.8633 0.14771 0.00154382 2026-02-17T19:10:13.583 INFO:tasks.workunit.client.0.trial067.stdout: 15 16 144201 144185 37.5452 0.472656 0.102815 0.00165297 2026-02-17T19:10:14.583 INFO:tasks.workunit.client.0.trial067.stdout: 16 16 144302 144286 35.2233 0.394531 0.154891 0.0017643 2026-02-17T19:10:15.583 INFO:tasks.workunit.client.0.trial067.stdout: 17 16 150017 150001 34.4645 22.3242 0.00168394 0.00181196 2026-02-17T19:10:16.583 INFO:tasks.workunit.client.0.trial067.stdout: 18 16 159614 159598 34.6323 37.4883 0.000994627 0.00180306 2026-02-17T19:10:17.583 INFO:tasks.workunit.client.0.trial067.stdout: 19 16 168848 168832 34.7078 36.0703 0.00199218 0.00179924 2026-02-17T19:10:18.583 INFO:tasks.workunit.client.0.trial067.stdout:2026-02-17T19:10:18.576189+0000 min lat: 0.000439445 max lat: 0.29839 avg lat: 0.00179444 2026-02-17T19:10:18.583 INFO:tasks.workunit.client.0.trial067.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T19:10:18.583 INFO:tasks.workunit.client.0.trial067.stdout: 20 16 178207 178191 34.8002 36.5586 0.00174709 0.00179444 2026-02-17T19:10:19.583 INFO:tasks.workunit.client.0.trial067.stdout: 21 16 187443 187427 34.8609 36.0781 0.00161138 0.00179136 2026-02-17T19:10:20.583 INFO:tasks.workunit.client.0.trial067.stdout: 22 16 191470 191454 33.9913 15.7305 0.176397 0.00183186 2026-02-17T19:10:21.583 INFO:tasks.workunit.client.0.trial067.stdout: 23 16 191536 191520 32.5247 0.257812 0.493263 0.00190923 2026-02-17T19:10:22.583 INFO:tasks.workunit.client.0.trial067.stdout: 24 16 198406 198390 32.2875 26.8359 0.00184731 0.00193422 2026-02-17T19:10:23.583 INFO:tasks.workunit.client.0.trial067.stdout: 25 16 207791 207775 32.4623 36.6602 0.00155256 0.00192382 2026-02-17T19:10:24.583 INFO:tasks.workunit.client.0.trial067.stdout: 26 16 217318 217302 32.645 37.2148 0.00160608 0.00191305 2026-02-17T19:10:25.583 INFO:tasks.workunit.client.0.trial067.stdout: 27 16 226689 226673 32.7916 36.6055 0.00114929 0.0019041 2026-02-17T19:10:26.583 INFO:tasks.workunit.client.0.trial067.stdout: 28 16 235979 235963 32.9164 36.2891 0.00146813 0.00189724 2026-02-17T19:10:27.584 INFO:tasks.workunit.client.0.trial067.stdout: 29 16 245441 245425 33.0558 36.9609 0.0015546 0.00188926 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Total time run: 30.001 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Total writes made: 254734 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Write size: 4096 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Object size: 4096 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Bandwidth (MB/sec): 33.1674 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Stddev Bandwidth: 13.3723 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Max bandwidth (MB/sec): 43.5 2026-02-17T19:10:28.584 INFO:tasks.workunit.client.0.trial067.stdout:Min bandwidth (MB/sec): 0.257812 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Average IOPS: 8490 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Stddev IOPS: 3423.31 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Max IOPS: 11136 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Min IOPS: 66 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Average Latency(s): 0.00188292 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Stddev Latency(s): 0.00792107 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Max latency(s): 0.493263 2026-02-17T19:10:28.585 INFO:tasks.workunit.client.0.trial067.stdout:Min latency(s): 0.000439445 2026-02-17T19:10:28.587 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-17T19:10:28.587 INFO:tasks.workunit.client.0.trial067.stdout:after bench 2026-02-17T19:10:28.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 85141 2026-02-17T19:10:28.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-17T19:10:29.588 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 85141 2026-02-17T19:10:29.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (85141) - No such process 2026-02-17T19:10:29.589 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-17T19:10:29.805 INFO:tasks.workunit.client.0.trial067.stderr:osd.0 is already down. 2026-02-17T19:10:29.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87372 2026-02-17T19:10:29.816 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-17T19:10:30.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87372 2026-02-17T19:10:30.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (87372) - No such process 2026-02-17T19:10:30.817 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-17T19:10:31.027 INFO:tasks.workunit.client.0.trial067.stderr:osd.1 is already down. 2026-02-17T19:10:31.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89728 2026-02-17T19:10:31.038 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-17T19:10:32.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89728 2026-02-17T19:10:32.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (89728) - No such process 2026-02-17T19:10:32.040 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-17T19:10:32.257 INFO:tasks.workunit.client.0.trial067.stderr:osd.2 is already down. 2026-02-17T19:10:32.267 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91911 2026-02-17T19:10:32.267 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-17T19:10:33.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91911 2026-02-17T19:10:33.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (91911) - No such process 2026-02-17T19:10:33.269 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-17T19:10:33.533 INFO:tasks.workunit.client.0.trial067.stderr:osd.3 is already down. 2026-02-17T19:10:33.543 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T19:10:37.698 INFO:tasks.workunit.client.0.trial067.stdout:fsck success 2026-02-17T19:10:37.737 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T19:10:41.862 INFO:tasks.workunit.client.0.trial067.stdout:fsck success 2026-02-17T19:10:41.902 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T19:10:45.882 INFO:tasks.workunit.client.0.trial067.stdout:fsck success 2026-02-17T19:10:45.922 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T19:10:49.990 INFO:tasks.workunit.client.0.trial067.stdout:fsck success 2026-02-17T19:10:50.028 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-17T19:10:50.030 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-17T19:10:50.047 INFO:tasks.workunit.client.0.trial067.stdout:inferring bluefs devices from bluestore path 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:2 : device size 0x100000000(4 GiB) : using 0xaea09000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaea09000(2.7 GiB) 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:Expanding DB/WAL... 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:0 : nothing to do, skipped 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:1 : nothing to do, skipped 2026-02-17T19:10:53.350 INFO:tasks.workunit.client.0.trial067.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-17T19:10:53.351 INFO:tasks.workunit.client.0.trial067.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-17T19:10:57.241 INFO:tasks.workunit.client.0.trial067.stderr:./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fdb591f7d40 time 2026-02-17T19:10:57.234465+0000 2026-02-17T19:10:57.241 INFO:tasks.workunit.client.0.trial067.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-17T19:10:57.242 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fdb5ad21ecf] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.243 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 16: main() 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 18: __libc_start_main() 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr: 19: _start() 2026-02-17T19:10:57.244 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fdb591f7d40 time 2026-02-17T19:10:57.234465+0000 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fdb5ad21ecf] 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.245 INFO:tasks.workunit.client.0.trial067.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 16: main() 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 18: __libc_start_main() 2026-02-17T19:10:57.246 INFO:tasks.workunit.client.0.trial067.stderr: 19: _start() 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr:*** Caught signal (Aborted) ** 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: in thread 7fdb591f7d40 thread_name:ceph-bluestore- 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb5a401520] 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 2: pthread_kill() 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 3: raise() 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 4: abort() 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fdb5ad21f2e] 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.247 INFO:tasks.workunit.client.0.trial067.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.248 INFO:tasks.workunit.client.0.trial067.stderr: 20: main() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 22: __libc_start_main() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 23: _start() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr:2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 *** Caught signal (Aborted) ** 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: in thread 7fdb591f7d40 thread_name:ceph-bluestore- 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb5a401520] 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 2: pthread_kill() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 3: raise() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 4: abort() 2026-02-17T19:10:57.249 INFO:tasks.workunit.client.0.trial067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fdb5ad21f2e] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.250 INFO:tasks.workunit.client.0.trial067.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 20: main() 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 22: __libc_start_main() 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 23: _start() 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: -499> 2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fdb591f7d40 time 2026-02-17T19:10:57.234465+0000 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.251 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fdb5ad21ecf] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.252 INFO:tasks.workunit.client.0.trial067.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 16: main() 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 18: __libc_start_main() 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 19: _start() 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: -498> 2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 *** Caught signal (Aborted) ** 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: in thread 7fdb591f7d40 thread_name:ceph-bluestore- 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.253 INFO:tasks.workunit.client.0.trial067.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb5a401520] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 2: pthread_kill() 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 3: raise() 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 4: abort() 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fdb5ad21f2e] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.254 INFO:tasks.workunit.client.0.trial067.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 20: main() 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 22: __libc_start_main() 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 23: _start() 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.255 INFO:tasks.workunit.client.0.trial067.stderr: -499> 2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7fdb591f7d40 time 2026-02-17T19:10:57.234465+0000 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr:./src/os/bluestore/BlueStore.h: 4588: FAILED ceph_assert(cur >= size_less) 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7fdb5ad21ecf] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.256 INFO:tasks.workunit.client.0.trial067.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 16: main() 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 18: __libc_start_main() 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 19: _start() 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.257 INFO:tasks.workunit.client.0.trial067.stderr: -498> 2026-02-17T19:10:57.231+0000 7fdb591f7d40 -1 *** Caught signal (Aborted) ** 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: in thread 7fdb591f7d40 thread_name:ceph-bluestore- 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb5a401520] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 2: pthread_kill() 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 3: raise() 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 4: abort() 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fdb5ad21f2e] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x55a15b2f46d6] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x55a15b3fb5e2] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x55a15b41b7c3] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x55a15b54e377] 2026-02-17T19:10:57.258 INFO:tasks.workunit.client.0.trial067.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x55a15b701503] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x55a15b5f92e3] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55a15b5fe71e] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55a15b5ff009] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x55a15b60d0c2] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x55a15b60e628] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55a15b3c16d4] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55a15b46f022] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55a15b46fee4] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55a15b47971d] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 20: main() 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdb5a3e8d90] 2026-02-17T19:10:57.259 INFO:tasks.workunit.client.0.trial067.stderr: 22: __libc_start_main() 2026-02-17T19:10:57.260 INFO:tasks.workunit.client.0.trial067.stderr: 23: _start() 2026-02-17T19:10:57.260 INFO:tasks.workunit.client.0.trial067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T19:10:57.260 INFO:tasks.workunit.client.0.trial067.stderr: 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 19: 94549 Aborted (core dumped) ceph-bluestore-tool --path $dir/0 bluefs-bdev-expand 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: return 1 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-17T19:10:57.577 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T19:10:57.578 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T19:10:57.578 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T19:10:57.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T19:10:57.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T19:10:57.578 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T19:10:57.687 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T19:10:57.688 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T19:10:57.688 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T19:10:57.689 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T19:10:57.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T19:10:57.690 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T19:10:57.691 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T19:10:57.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:10:57.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T19:10:57.692 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T19:10:57.693 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T19:10:57.694 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:10:57.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: cores=yes 2026-02-17T19:10:57.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:173: teardown: '[' -n '' ']' 2026-02-17T19:10:57.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' yes = yes -o 1 = 1 ']' 2026-02-17T19:10:57.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-17T19:10:57.695 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-17T19:10:57.696 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log td/osd-bluefs-volume-ops/osd.1.log td/osd-bluefs-volume-ops/osd.2.log td/osd-bluefs-volume-ops/osd.3.log /home/ubuntu/cephtest/archive/log 2026-02-17T19:10:57.697 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T19:10:57.850 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T19:10:57.850 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T19:10:57.850 INFO:tasks.workunit.client.0.trial067.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83665 2026-02-17T19:10:57.850 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83665 2026-02-17T19:10:57.851 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' yes = yes ']' 2026-02-17T19:10:57.851 INFO:tasks.workunit.client.0.trial067.stdout:ERROR: Failure due to cores found 2026-02-17T19:10:57.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T19:10:57.852 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:192: teardown: echo 'ERROR: Failure due to cores found' 2026-02-17T19:10:57.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:193: teardown: '[' -n '' ']' 2026-02-17T19:10:57.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:196: teardown: return 1 2026-02-17T19:10:57.853 INFO:tasks.workunit.client.0.trial067.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: return 1 2026-02-17T19:10:57.853 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-17T19:10:57.853 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T19:10:58.208 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-17T19:10:58.213 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T19:10:58.227 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T19:10:58.227 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T19:10:58.333 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T19:10:58.344 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T19:10:58.344 DEBUG:teuthology.orchestra.run.trial067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout:============================================================================== 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout:-ntp.maxhost.io 132.163.97.4 2 u 19 64 257 69.647 +7.440 1.492 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout:*23.155.72.147 ( 138.89.14.60 2 u 24 64 377 30.136 +9.177 1.358 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout:+owners.kjsl.com 23.131.160.13 2 u 38 64 373 64.601 +9.425 2.844 2026-02-17T19:10:58.419 INFO:teuthology.orchestra.run.trial067.stdout:+arm1.maxhost.io 42.20.202.230 2 u 22 64 377 66.102 +7.956 1.297 2026-02-17T19:10:58.420 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T19:10:58.432 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T19:10:58.432 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T19:10:58.445 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T19:10:58.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T19:10:58.479 INFO:teuthology.task.internal:Duration was 2187.858761 seconds 2026-02-17T19:10:58.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T19:10:58.494 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T19:10:58.494 DEBUG:teuthology.orchestra.run.trial067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T19:10:58.521 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T19:10:58.521 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial067.front.sepia.ceph.com 2026-02-17T19:10:58.521 DEBUG:teuthology.orchestra.run.trial067:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T19:10:58.567 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T19:10:58.567 DEBUG:teuthology.orchestra.run.trial067:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T19:10:58.774 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T19:10:58.775 DEBUG:teuthology.orchestra.run.trial067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T19:10:58.784 INFO:teuthology.orchestra.run.trial067.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T19:10:58.785 INFO:teuthology.orchestra.run.trial067.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T19:10:58.786 INFO:teuthology.orchestra.run.trial067.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T19:10:58.786 INFO:teuthology.orchestra.run.trial067.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T19:10:58.786 INFO:teuthology.orchestra.run.trial067.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T19:10:58.835 INFO:teuthology.orchestra.run.trial067.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T19:10:58.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T19:10:58.853 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T19:10:58.853 DEBUG:teuthology.orchestra.run.trial067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T19:10:58.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T19:10:58.906 DEBUG:teuthology.orchestra.run.trial067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:10:58.949 INFO:teuthology.orchestra.run.trial067.stdout:kernel.core_pattern = core 2026-02-17T19:10:58.962 DEBUG:teuthology.orchestra.run.trial067:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T19:10:59.008 WARNING:teuthology.task.internal:Found coredumps on ubuntu@trial067.front.sepia.ceph.com, flagging run as failed 2026-02-17T19:10:59.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T19:10:59.021 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T19:10:59.022 DEBUG:teuthology.misc:Transferring archived files from trial067:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_15:45:02-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/53793/remote/trial067 2026-02-17T19:10:59.024 DEBUG:teuthology.orchestra.run.trial067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T19:15:18.696 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2026-02-17T19:15:18.712 INFO:teuthology.task.internal: core looks like: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_15:45:02-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/53793/remote/trial067/coredump/1771355457.94549.core.gz: gzip compressed data, was "1771355457.94549.core", last modified: Tue Feb 17 19:10:59 2026, max compression, original size modulo 2^32 389255168 2026-02-17T19:15:18.712 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2026-02-17T19:15:19.425 INFO:teuthology.task.internal: core looks like: /tmp/tmp8fxt3mrq: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand', real uid: 1000, effective uid: 1000, real gid: 1002, effective gid: 1002, execfn: '/usr/bin/ceph-bluestore-tool', platform: 'x86_64' 2026-02-17T19:15:19.429 INFO:teuthology.task.internal: dump_program: ceph-bluestore-tool 2026-02-17T19:15:19.430 DEBUG:teuthology.orchestra.run.trial067:> which ceph-bluestore-tool 2026-02-17T19:15:19.434 INFO:teuthology.orchestra.run.trial067.stdout:/usr/bin/ceph-bluestore-tool 2026-02-17T19:15:19.484 DEBUG:teuthology.orchestra.remote:trial067:/usr/bin/ceph-bluestore-tool is 242MB 2026-02-17T19:15:20.957 DEBUG:teuthology.orchestra.run.trial067:> mktemp 2026-02-17T19:15:20.960 INFO:teuthology.orchestra.run.trial067.stdout:/tmp/tmp.L0GWC7pmBr 2026-02-17T19:15:20.961 DEBUG:teuthology.orchestra.run.trial067:> sudo cp /usr/bin/ceph-bluestore-tool /tmp/tmp.L0GWC7pmBr 2026-02-17T19:15:21.347 DEBUG:teuthology.orchestra.run.trial067:> sudo chmod 0666 /tmp/tmp.L0GWC7pmBr 2026-02-17T19:15:21.401 DEBUG:teuthology.orchestra.remote:trial067:/tmp/tmp.L0GWC7pmBr is 242MB 2026-02-17T19:15:22.844 DEBUG:teuthology.orchestra.run.trial067:> rm -fr /tmp/tmp.L0GWC7pmBr 2026-02-17T19:15:22.884 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T19:15:22.884 DEBUG:teuthology.orchestra.run.trial067:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T19:15:24.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T19:15:24.312 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T19:15:24.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T19:15:24.329 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T19:15:24.329 DEBUG:teuthology.orchestra.run.trial067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T19:15:24.334 INFO:teuthology.orchestra.run.trial067.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 19:15 /home/ubuntu/cephtest 2026-02-17T19:15:24.334 INFO:teuthology.orchestra.run.trial067.stdout: 1190961 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 18:36 /home/ubuntu/cephtest/mnt.0 2026-02-17T19:15:24.334 INFO:teuthology.orchestra.run.trial067.stdout: 1190962 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 19:09 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T19:15:24.335 INFO:teuthology.orchestra.run.trial067.stdout: 1206854 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 19:09 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T19:15:24.335 INFO:teuthology.orchestra.run.trial067.stdout: 1206855 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 17 19:10 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-17T19:15:24.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T19:15:24.336 INFO:teuthology.orchestra.run.trial067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T19:15:24.336 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T19:15:24.338 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T19:15:24.356 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T19:15:24.373 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T19:15:24.379 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 2187.8587613105774 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial067 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T19:15:24.379 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T19:15:24.496 INFO:teuthology.run:FAIL